00000001:02000400:2.0F:1787574118.825061:0:3289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787574139.884077:0:3510:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787574142.481664:0:3573:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 431 MB/s 00000001:01000000:0.0F:1787574142.732346:0:3573:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 422 MB/s 00000001:01000000:3.0:1787574142.983415:0:3573:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2091 MB/s 00000020:02000000:2.0:1787574144.021904:0:3603:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g1214e44 00000400:02000000:1.0F:1787574145.187595:0:3618:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.140@tcp [8/256/0/180] 00008000:02000000:1.0:1787574149.096408:0:3767:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787574218.547616:0:5736:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787574233.671079:0:6486:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787574233.671087:0:6486:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787574233.671089:0:6486:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787574233.671211:0:6486:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003da1471b 00000080:02000400:3.0:1787574233.671221:0:6486:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787574233.677287:0:6486:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787574233.677299:0:6486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787574233.677336:0:6486:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000005d6daa2b) 00000020:00000080:3.0:1787574233.677356:0:6486:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787574233.733007:0:6486:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787574233.733092:0:6486:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1787574233.759908:0:6486:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787574233.760411:0:6486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787574233.760419:0:6486:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787574233.760431:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb79be 00000020:01000004:2.0:1787574233.760447:0:6486:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787574233.760452:0:6486:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787574233.760457:0:6486:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003da1471b from MGS 00000020:01000004:2.0:1787574233.760462:0:6486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787574233.760481:0:6486:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000032b6b792) 00000020:00000080:2.0:1787574233.760493:0:6486:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787574233.760579:0:6486:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003da1471b from MGS, refs=2 00080000:01000000:2.0:1787574233.760585:0:6486:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787574233.760591:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb79cc 00000100:00100000:2.0:1787574233.760688:0:6486:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787574233.760854:0:6486:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787574233.760860:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787574233.761664:0:6486:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787574233.761670:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787574233.762867:0:6486:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574233.763028:0:6486:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787574233.763033:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787574233.768496:0:6486:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787574233.768509:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787574233.781029:0:6486:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787574233.781050:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787574233.788612:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574233.788618:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574233.788620:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574233.789679:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574233.789683:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574233.789684:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574233.791647:0:6486:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787574233.792443:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787574234.041344:0:6486:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2000 MB/s 00000001:01000000:2.0:1787574234.291272:0:6486:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2771 MB/s 00000001:01000000:0.0:1787574234.543808:0:6486:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 408 MB/s 00000001:01000000:2.0:1787574234.793670:0:6486:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 511 MB/s 00080000:10000000:2.0:1787574234.801921:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:0.0:1787574234.802489:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787574234.816825:0:6486:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787574234.817961:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787574234.818011:0:6486:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787574234.818061:0:6486:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787574234.818316:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787574234.818418:0:6486:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787574234.819475:0:6486:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574234.820041:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787574234.820047:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787574234.829127:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787574234.829146:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787574234.829419:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787574234.829435:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787574234.829715:0:6486:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787574234.829736:0:6486:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.140@tcp' 00000020:01000004:3.0:1787574234.829738:0:6486:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787574234.829775:0:6486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.140@tcp (typ=mgc) 00000020:00000080:3.0:1787574234.829786:0:6486:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.140@tcp (000000001c13cc74) 00000020:00000080:3.0:1787574234.829801:0:6486:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787574234.829902:0:6486:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000085a8500@MGC192.168.202.140@tcp: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1787574234.830056:0:6486:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.140@tcp-0 is initialized 00000040:01000000:3.0:1787574234.830067:0:6486:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787574234.830342:0:6505:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787574234.841526:0:6506:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787574234.841584:0:6486:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.140@tcp (uuid 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1) 00000020:00000080:3.0:1787574234.841606:0:6486:0:(genops.c:1385:class_connect()) connect: client 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1, cookie 0xd18a1efeeddb79da 00000100:00080000:3.0:1787574234.841618:0:6486:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574234.841623:0:6486:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import 00000000085a8500 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574234.841670:0:6486:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001012be42 x1874407346667648/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574234.841689:0:6486:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS 00000020:01000004:3.0:1787574234.841706:0:6486:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787574234.841713:0:6486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787574234.841726:0:6486:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000096da078a) 00000020:00000080:3.0:1787574234.841739:0:6486:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787574234.842170:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001012be42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3633:1874407346667648:0@lo:250: 00000100:00100000:2.0:1787574234.842300:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574234.848838:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346667648 00000100:00100000:2.0:1787574234.849041:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346667648 00000100:00100000:2.0:1787574234.849084:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574234.849092:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9c8f248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3633:x1874407346667648:12345-0@lo:250: 00010000:00080000:2.0:1787574234.849120:0:6501:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:2.0:1787574234.849160:0:6501:0:(genops.c:1385:class_connect()) connect: client 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1, cookie 0xd18a1efeeddb79e8 00000100:00080000:2.0:1787574234.851602:0:6501:0:(import.c:65:import_set_state_nolock()) 00000000c199be56 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574234.851720:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9c8f248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:3633:x1874407346667648:12345-0@lo:250: Request processed in 2626us (9419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574234.851730:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574234.851784:0:3633:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787574234.851793:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.140@tcp: connect to target with instance 0 00000100:00080000:2.0:1787574234.851801:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787574234.851807:0:3633:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787574234.851811:0:3633:0:(import.c:65:import_set_state_nolock()) 00000000085a8500 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787574234.851813:0:3633:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787574234.851816:0:3633:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787574234.851820:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001012be42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3633:1874407346667648:0@lo:250: 00000100:00100000:3.0:1787574234.862172:0:6486:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574234.862385:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787574234.862391:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787574234.880629:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787574234.880651:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787574234.889577:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787574234.889590:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787574234.900756:0:6486:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574234.900957:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787574234.900963:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787574234.904357:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787574234.904373:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787574234.967517:0:6486:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574234.967748:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787574234.967755:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787574234.972101:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787574234.972116:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787574234.973530:0:6486:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574234.973732:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787574234.973737:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787574234.975210:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787574234.975226:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787574234.976100:0:6486:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574234.976333:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787574234.977876:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787574234.981878:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787574234.981894:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787574234.984097:0:6486:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574234.986810:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787574234.986824:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787574234.989978:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787574234.990007:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787574235.013179:0:6486:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574235.013449:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787574235.013456:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787574235.020266:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787574235.020294:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787574235.021228:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787574235.021264:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787574235.022127:0:6486:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787574235.022156:0:6486:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787574235.022162:0:6486:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787574235.022295:0:6486:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787574235.022330:0:6486:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787574235.022334:0:6486:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787574235.022347:0:6486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787574235.022348:0:6486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574235.022349:0:6486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574235.022350:0:6486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574235.022351:0:6486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574235.022353:0:6486:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787574235.022354:0:6486:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787574235.022355:0:6486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787574235.022357:0:6486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787574235.022358:0:6486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574235.022359:0:6486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787574235.022361:0:6486:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787574235.022363:0:6486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787574235.022365:0:6486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787574235.022366:0:6486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574235.022367:0:6486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574235.022368:0:6486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574235.022369:0:6486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574235.022370:0:6486:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787574235.022371:0:6486:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787574235.022372:0:6486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787574235.022373:0:6486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787574235.022374:0:6486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574235.022375:0:6486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787574235.022403:0:6486:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787574235.022421:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023c402d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346667776:0@lo:253: 00000100:00100000:3.0:1787574235.022526:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574235.022589:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a5dd7dc going to sleep for 11 seconds 00000100:00100000:0.0:1787574235.022725:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346667776 00000100:00100000:0.0:1787574235.022733:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346667776 00000100:00100000:0.0:1787574235.022785:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574235.022794:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ab98403 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:6486:x1874407346667776:12345-0@lo:253: 20000000:01000000:0.0:1787574235.022835:0:6504:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787574235.022838:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787574235.023368:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787574235.023483:0:6504:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787574235.023781:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574235.026097:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787574235.026394:0:6504:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787574235.026399:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787574235.026407:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787574235.026410:0:6504:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787574235.026448:0:6504:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787574235.026635:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574235.026836:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787574235.027030:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787574235.027053:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787574235.027069:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787574235.027084:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787574235.027136:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787574235.027144:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787574235.027157:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787574235.027162:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787574235.027174:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787574235.027179:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787574235.027190:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787574235.027201:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787574235.027223:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787574235.027227:0:6504:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787574235.027232:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574235.027595:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787574235.027607:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787574235.027622:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787574235.027637:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787574235.027667:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787574235.027680:0:6504:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787574235.027708:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787574235.027715:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787574235.027725:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787574235.027738:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787574235.027750:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787574235.027757:0:6504:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787574235.027777:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787574235.027784:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787574235.027808:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787574235.027822:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787574235.028002:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787574235.028023:0:6504:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787574235.028028:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787574235.043092:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787574235.046657:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787574235.046693:0:6504:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.140@tcp for mdt 20000000:01000000:0.0:1787574235.046696:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:0.0:1787574235.046713:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787574235.046719:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787574235.046734:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787574235.046739:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:0.0:1787574235.046752:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787574235.046769:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787574235.046785:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787574235.046802:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787574235.046832:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787574235.046834:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787574235.046838:0:6504:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787574235.048035:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787574235.048042:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787574235.052843:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787574235.053157:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787574235.053186:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787574235.053200:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787574235.053211:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787574235.053213:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787574235.053767:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787574235.053941:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787574235.053965:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787574235.053980:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787574235.053994:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574235.053996:0:6504:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787574235.054001:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787574235.054003:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787574235.054009:0:6504:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787574235.054015:0:6504:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787574235.054647:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787574235.054757:0:6504:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787574235.066143:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787574235.066177:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787574235.066193:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787574235.066210:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787574235.066231:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d3f0f123/0xd18a1efeeddb79ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.066503:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3f0f123/0xd18a1efeeddb79ef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.066513:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3f0f123/0xd18a1efeeddb79ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.066536:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3f0f123/0xd18a1efeeddb79ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.066541:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d3f0f123/0xd18a1efeeddb79ef lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.066547:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d3f0f123/0xd18a1efeeddb79ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.066553:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3f0f123 already unused, calling callback (00000000b88c46cf) 00010000:00010000:1.0:1787574235.066557:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d3f0f123/0xd18a1efeeddb79ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.066564:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d3f0f123/0xd18a1efeeddb79ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.066576:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d3f0f123/0xd18a1efeeddb79ef lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.066582:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d3f0f123/0xd18a1efeeddb79ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.066587:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d3f0f123/0xd18a1efeeddb79ef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787574235.066604:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787574235.087899:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ab98403 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:6486:x1874407346667776:12345-0@lo:253: Request processed in 65099us (65366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574235.087919:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574235.088031:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023c402d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346667776:0@lo:253: 10000000:01000000:3.0:1787574235.088045:0:6486:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787574235.088049:0:6486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787574235.088051:0:6486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787574235.088052:0:6486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574235.088053:0:6486:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787574235.088054:0:6486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574235.088055:0:6486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574235.088056:0:6486:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787574235.088058:0:6486:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787574235.088059:0:6486:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787574235.088061:0:6486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574235.088062:0:6486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787574235.088089:0:6486:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003da1471b from lustre-MDT0000 10000000:01000000:3.0:1787574235.088116:0:6486:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787574235.088119:0:6486:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787574235.088123:0:6486:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ca5050d4d28 10000000:01000000:3.0:1787574235.088127:0:6486:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787574235.088134:0:6486:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ca5050d4d28 from 1 10000000:01000000:3.0:1787574235.088136:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787574235.088168:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574235.088177:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574235.088203:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574235.088220:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023c402d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346667904:0@lo:101: 00000100:00100000:3.0:1787574235.088275:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574235.088330:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 000000000c3323f8 going to sleep for 11 seconds 00000100:00100000:2.0:1787574235.088469:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346667904 00000100:00100000:2.0:1787574235.088477:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346667904 00000100:00100000:2.0:1787574235.088517:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574235.088524:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f60e417f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:6486:x1874407346667904:12345-0@lo:101: 00010000:00010000:2.0:1787574235.088537:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574235.088549:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb79fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb79f6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.088570:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb79fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb79f6 expref: 6 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.088580:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb79fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb79f6 expref: 6 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.088589:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e9c32a6, rc 0) 00000100:00100000:2.0:1787574235.088626:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f60e417f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+6:6486:x1874407346667904:12345-0@lo:101: Request processed in 102us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574235.088632:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574235.088748:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023c402d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346667904:0@lo:101: 00010000:00010000:1.0:1787574235.088766:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.088774:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574235.088846:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ff83763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668032:0@lo:501: 00000100:00100000:1.0:1787574235.088874:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574235.088898:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f720ab62 going to sleep for 11 seconds 00000100:00100000:0.0:1787574235.088957:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346668032 00000100:00100000:0.0:1787574235.088961:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346668032 00000100:00100000:0.0:1787574235.088989:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574235.088994:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb519861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+6:6486:x1874407346668032:12345-0@lo:501: 00000100:00100000:0.0:1787574235.089070:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb519861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+6:6486:x1874407346668032:12345-0@lo:501: Request processed in 76us (195us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787574235.089076:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787574235.089179:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ff83763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668032:0@lo:501: 10000000:01000000:1.0:1787574235.089203:0:6486:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787574235.089219:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.089227:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574235.089235:0:6486:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca5109bd800 10000000:01000000:1.0:1787574235.089276:0:6486:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787574235.089281:0:6486:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ca5109bd800 10000000:01000000:1.0:1787574235.089283:0:6486:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787574235.089286:0:6486:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ca5109bd800 from 1 10000000:01000000:1.0:1787574235.089288:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787574235.089306:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000d3f0f123/0xd18a1efeeddb7a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.089312:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000d3f0f123/0xd18a1efeeddb7a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.089331:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000d3f0f123/0xd18a1efeeddb7a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574235.089352:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ff83763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668160:0@lo:101: 00000100:00100000:1.0:1787574235.089379:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574235.089390:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f720ab62 going to sleep for 11 seconds 00000100:00100000:0.0:1787574235.089532:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346668160 00000100:00100000:0.0:1787574235.089537:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346668160 00000100:00100000:0.0:1787574235.089568:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574235.089574:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059b8ee92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+6:6486:x1874407346668160:12345-0@lo:101: 00010000:00010000:0.0:1787574235.089582:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574235.089593:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001dca7cf0/0xd18a1efeeddb7a0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7a04 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574235.089606:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001dca7cf0/0xd18a1efeeddb7a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a04 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574235.089624:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001dca7cf0/0xd18a1efeeddb7a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a04 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574235.089630:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001dca7cf0, rc 0) 00000100:00100000:0.0:1787574235.089658:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059b8ee92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+7:6486:x1874407346668160:12345-0@lo:101: Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574235.089663:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574235.090101:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ff83763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668160:0@lo:101: 00010000:00010000:1.0:1787574235.090115:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000d3f0f123/0xd18a1efeeddb7a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.090123:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000d3f0f123/0xd18a1efeeddb7a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574235.090135:0:6486:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787574235.090149:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000d3f0f123/0xd18a1efeeddb7a04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.090156:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000d3f0f123/0xd18a1efeeddb7a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574235.090161:0:6486:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787574235.090166:0:6486:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787574235.090170:0:6486:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ca5109bd800 10000000:01000000:1.0:1787574235.090172:0:6486:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787574235.090175:0:6486:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787574235.090176:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787574235.090191:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.090204:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.090210:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574235.090222:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ff83763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668288:0@lo:101: 00000100:00100000:1.0:1787574235.090269:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574235.090298:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f720ab62 going to sleep for 11 seconds 00000100:00100000:0.0:1787574235.090364:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346668288 00000100:00100000:0.0:1787574235.090369:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346668288 00000100:00100000:0.0:1787574235.090398:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574235.090404:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000865d027c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+7:6486:x1874407346668288:12345-0@lo:101: 00010000:00010000:0.0:1787574235.090411:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574235.090418:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7a19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7a12 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574235.090441:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a12 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574235.090448:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a12 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574235.090454:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049ab38bd, rc 0) 00000100:00100000:0.0:1787574235.090485:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000865d027c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+8:6486:x1874407346668288:12345-0@lo:101: Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574235.090491:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574235.090652:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ff83763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668288:0@lo:101: 00010000:00010000:1.0:1787574235.090663:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.090670:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574235.090715:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ff83763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668416:0@lo:501: 00000100:00100000:1.0:1787574235.090739:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574235.090761:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f720ab62 going to sleep for 11 seconds 00000100:00100000:3.0:1787574235.090814:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346668416 00000100:00100000:3.0:1787574235.090818:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346668416 00000100:00100000:3.0:1787574235.090848:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574235.090866:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dc7fb97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+8:6486:x1874407346668416:12345-0@lo:501: 00000100:00100000:3.0:1787574235.090976:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dc7fb97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:6486:x1874407346668416:12345-0@lo:501: Request processed in 111us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574235.090983:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574235.091157:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ff83763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668416:0@lo:501: 00000100:00100000:1.0:1787574235.091195:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ff83763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668544:0@lo:503: 00000100:00100000:1.0:1787574235.091228:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574235.091271:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f720ab62 going to sleep for 11 seconds 00000100:00100000:3.0:1787574235.091477:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346668544 00000100:00100000:3.0:1787574235.091481:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346668544 00000100:00100000:3.0:1787574235.091507:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574235.091512:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000124f2799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:6486:x1874407346668544:12345-0@lo:503: 00000100:00100000:3.0:1787574235.091590:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000124f2799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:6486:x1874407346668544:12345-0@lo:503: Request processed in 79us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574235.091596:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574235.091696:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ff83763 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668544:0@lo:503: 00000100:00100000:2.0:1787574235.092210:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6531:1874407346668672:0@lo:502: 00000100:00100000:2.0:1787574235.092295:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574235.092327:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e47ce54 going to sleep for 11 seconds 00000100:00100000:3.0:1787574235.092510:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346668672 00000100:00100000:3.0:1787574235.092516:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346668672 00000100:00100000:3.0:1787574235.092550:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574235.092557:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079df32c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:6531:x1874407346668672:12345-0@lo:502: 00000100:00100000:3.0:1787574235.092656:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079df32c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:6531:x1874407346668672:12345-0@lo:502: Request processed in 99us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574235.092672:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787574235.092797:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6531:1874407346668672:0@lo:502: 00000020:01000000:2.0:1787574235.092821:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574235.092841:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574235.092844:0:6531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787574235.092964:0:6531:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787574235.092968:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574235.092982:0:6531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000813d9014) 00000020:00000080:2.0:1787574235.093001:0:6531:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787574235.093007:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787574235.093089:0:6531:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787574235.093095:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb7a27 00000020:00000080:2.0:1787574235.093473:0:6531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787574235.093478:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574235.093481:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574235.093483:0:6531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787574235.093485:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574235.093488:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574235.093489:0:6531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787574235.093492:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574235.093499:0:6531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000166f38b0) 00000020:00000080:2.0:1787574235.093509:0:6531:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787574235.093512:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787574235.093514:0:6531:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787574235.093516:0:6531:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787574235.093521:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787574235.093558:0:6531:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003da1471b from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787574235.093569:0:6531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000cbf54999) 00000020:00000080:2.0:1787574235.093576:0:6531:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787574235.093649:0:6531:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787574235.093655:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb7a3c 00000020:00000080:2.0:1787574235.093740:0:6531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787574235.093747:0:6531:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787574235.093750:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd18a1efeeddb7a43 00080000:01000000:2.0:1787574235.093754:0:6531:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787574235.093757:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb7a4a 00080000:10000000:2.0:1787574235.094830:0:6531:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787574235.094992:0:6531:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787574235.100396:0:6531:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787574235.169431:0:6531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787574235.169762:0:6531:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787574235.189594:0:6531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787574235.189982:0:6531:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787574235.202351:0:6531:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000832ea4f3) 00000020:00000080:2.0:1787574235.202380:0:6531:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787574235.202488:0:6531:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787574235.202496:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb7a58 00000020:00000080:3.0:1787574235.220457:0:6531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787574235.221452:0:6531:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1787574235.228132:0:6531:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1787574235.229890:0:6531:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1787574235.242155:0:6531:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1787574235.272592:0:6531:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1787574235.281635:0:6531:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1787574235.297278:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd18a1efeeddb7a5f 00000020:00000080:0.0:1787574235.297640:0:6531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787574235.297657:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574235.297663:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574235.297665:0:6531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787574235.297668:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574235.297672:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574235.297674:0:6531:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787574235.297676:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787574235.297678:0:6531:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787574235.297680:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574235.297682:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574235.297683:0:6531:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787574235.297685:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574235.297690:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574235.297691:0:6531:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787574235.297695:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787574235.297729:0:6531:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787574235.297791:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000458463ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6531:1874407346668800:0@lo:502: 00000100:00100000:0.0:1787574235.298484:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574235.298544:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 000000005423064f going to sleep for 11 seconds 00000100:00100000:2.0:1787574235.298635:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346668800 00000100:00100000:2.0:1787574235.298643:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346668800 00000100:00100000:2.0:1787574235.298694:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574235.298703:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c46e4567 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:6531:x1874407346668800:12345-0@lo:502: 00000100:00100000:2.0:1787574235.298834:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c46e4567 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:6531:x1874407346668800:12345-0@lo:502: Request processed in 132us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574235.298842:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574235.302561:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000458463ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6531:1874407346668800:0@lo:502: 00000020:01000000:0.0:1787574235.302610:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574235.302620:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574235.302622:0:6531:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787574235.302627:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787574235.303749:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787574235.303778:0:6486:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787574235.303791:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.303815:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574235.303824:0:6486:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca5109bd800 from 1 10000000:01000000:1.0:1787574235.303827:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574235.303873:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.303880:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.303889:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574235.303909:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000750c08d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668928:0@lo:101: 00000100:00100000:1.0:1787574235.303977:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574235.304026:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e9de05bc going to sleep for 11 seconds 00000100:00100000:3.0:1787574235.304155:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346668928 00000100:00100000:3.0:1787574235.304163:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346668928 00000100:00100000:3.0:1787574235.304211:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574235.304219:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059d58693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:6486:x1874407346668928:12345-0@lo:101: 00010000:00010000:3.0:1787574235.304232:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574235.304262:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f4cf2950/0xd18a1efeeddb7a6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7a66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574235.304285:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f4cf2950/0xd18a1efeeddb7a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a66 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574235.304295:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f4cf2950/0xd18a1efeeddb7a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a66 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574235.304303:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f4cf2950, rc 0) 00000100:00100000:3.0:1787574235.304356:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059d58693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+10:6486:x1874407346668928:12345-0@lo:101: Request processed in 137us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574235.304363:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574235.305479:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000750c08d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346668928:0@lo:101: 00010000:00010000:1.0:1787574235.305500:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.305510:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574235.306052:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000750c08d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669056:0@lo:256: 00000100:00100000:1.0:1787574235.306111:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574235.306159:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e9de05bc going to sleep for 11 seconds 00000100:00100000:0.0:1787574235.306469:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346669056 00000100:00100000:0.0:1787574235.306476:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346669056 00000100:00100000:0.0:1787574235.306515:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574235.306522:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cca44426 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+10:6486:x1874407346669056:12345-0@lo:256: 20000000:01000000:0.0:1787574235.306539:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787574235.306545:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787574235.306628:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cca44426 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+10:6486:x1874407346669056:12345-0@lo:256: Request processed in 106us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574235.306641:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574235.306807:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000750c08d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669056:0@lo:256: 10000000:01000000:2.0:1787574235.307399:0:6486:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574235.307417:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.307437:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574235.307445:0:6486:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca5109bd800 from 1 10000000:01000000:2.0:1787574235.307448:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574235.307480:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.307498:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.307507:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574235.307523:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669184:0@lo:101: 00000100:00100000:2.0:1787574235.307561:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574235.307591:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097527d6f going to sleep for 11 seconds 00000100:00100000:2.0:1787574235.307608:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346669184 00000100:00100000:2.0:1787574235.307612:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346669184 00000100:00100000:2.0:1787574235.307638:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574235.307645:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027b38416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+10:6486:x1874407346669184:12345-0@lo:101: 00010000:00010000:2.0:1787574235.307654:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574235.307667:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000925f75cc/0xd18a1efeeddb7a7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7a74 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.307686:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000925f75cc/0xd18a1efeeddb7a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a74 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.307695:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000925f75cc/0xd18a1efeeddb7a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a74 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.307703:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000925f75cc, rc 0) 00000100:00100000:2.0:1787574235.307733:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027b38416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:6486:x1874407346669184:12345-0@lo:101: Request processed in 89us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574235.307739:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574235.307767:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669184:0@lo:101: 00010000:00010000:2.0:1787574235.307781:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.307788:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574235.307846:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669312:0@lo:501: 00000100:00100000:2.0:1787574235.307867:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574235.307874:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097527d6f going to sleep for 11 seconds 00000100:00100000:2.0:1787574235.307890:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346669312 00000100:00100000:2.0:1787574235.307893:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346669312 00000100:00100000:2.0:1787574235.307906:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574235.307911:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000917575ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:6486:x1874407346669312:12345-0@lo:501: 00000100:00100000:2.0:1787574235.308066:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000917575ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:6486:x1874407346669312:12345-0@lo:501: Request processed in 155us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574235.308073:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574235.308093:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669312:0@lo:501: 00000100:00100000:2.0:1787574235.308124:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669440:0@lo:503: 00000100:00100000:2.0:1787574235.308155:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574235.308163:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097527d6f going to sleep for 11 seconds 00000100:00100000:2.0:1787574235.308177:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346669440 00000100:00100000:2.0:1787574235.308180:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346669440 00000100:00100000:2.0:1787574235.308192:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574235.308198:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6dcf47d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:6486:x1874407346669440:12345-0@lo:503: 00000040:00080000:2.0:1787574235.308224:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787574235.308283:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6dcf47d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:6486:x1874407346669440:12345-0@lo:503: Request processed in 86us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574235.308298:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574235.308326:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669440:0@lo:503: 00000040:00080000:2.0:1787574235.308935:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787574235.308984:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787574235.308999:0:6486:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787574235.309005:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.309012:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574235.309051:0:6486:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787574235.309053:0:6486:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca5109bd800 10000000:01000000:2.0:1787574235.309056:0:6486:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca5109bd800 10000000:01000000:2.0:1787574235.309059:0:6486:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787574235.309064:0:6486:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca5109bd800 from 1 10000000:01000000:2.0:1787574235.309066:0:6486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787574235.309085:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.309091:0:6486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.309098:0:6486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574235.309111:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669568:0@lo:101: 00000100:00100000:2.0:1787574235.309142:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574235.309156:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec9ac832 going to sleep for 11 seconds 00000100:00100000:2.0:1787574235.309180:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346669568 00000100:00100000:2.0:1787574235.309185:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346669568 00000100:00100000:2.0:1787574235.309205:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574235.309210:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000111d3782 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:6486:x1874407346669568:12345-0@lo:101: 00010000:00010000:2.0:1787574235.309219:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574235.309227:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2e37f41/0xd18a1efeeddb7a89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7a82 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.309274:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2e37f41/0xd18a1efeeddb7a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a82 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.309282:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2e37f41/0xd18a1efeeddb7a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a82 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.309289:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2e37f41, rc 0) 00000100:00100000:2.0:1787574235.309317:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000111d3782 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6486:x1874407346669568:12345-0@lo:101: Request processed in 107us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574235.309323:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574235.309353:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669568:0@lo:101: 00010000:00010000:2.0:1787574235.309363:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574235.309370:0:6486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574235.309404:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669696:0@lo:501: 00000100:00100000:2.0:1787574235.309439:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574235.309450:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec9ac832 going to sleep for 11 seconds 00000100:00100000:2.0:1787574235.309462:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346669696 00000100:00100000:2.0:1787574235.309471:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346669696 00000100:00100000:2.0:1787574235.309490:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574235.309494:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000629ed349 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6486:x1874407346669696:12345-0@lo:501: 00000100:00100000:2.0:1787574235.309580:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000629ed349 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6486:x1874407346669696:12345-0@lo:501: Request processed in 85us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574235.309587:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574235.309615:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669696:0@lo:501: 00000100:00100000:2.0:1787574235.309638:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669824:0@lo:503: 00000100:00100000:2.0:1787574235.309673:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574235.309684:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec9ac832 going to sleep for 11 seconds 00000100:00100000:2.0:1787574235.309697:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346669824 00000100:00100000:2.0:1787574235.309700:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346669824 00000100:00100000:2.0:1787574235.309717:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574235.309721:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c07514a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6486:x1874407346669824:12345-0@lo:503: 00000100:00100000:2.0:1787574235.309791:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c07514a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6486:x1874407346669824:12345-0@lo:503: Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574235.309797:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574235.309838:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005135ae0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346669824:0@lo:503: 00000100:00100000:0.0:1787574235.316740:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000458463ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6536:1874407346669952:0@lo:502: 00000100:00100000:0.0:1787574235.316831:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574235.316883:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078b1ae66 going to sleep for 11 seconds 00000100:00100000:3.0:1787574235.316931:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346669952 00000100:00100000:3.0:1787574235.316939:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346669952 00000100:00100000:3.0:1787574235.316988:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574235.316996:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d4aa4bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6536:x1874407346669952:12345-0@lo:502: 00000100:00100000:3.0:1787574235.317112:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d4aa4bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6536:x1874407346669952:12345-0@lo:502: Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574235.317119:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787574235.317197:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000458463ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6536:1874407346669952:0@lo:502: 00000020:01000004:0.0:1787574235.317277:0:6536:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787574235.317297:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000f06c1844) 00000020:00000080:0.0:1787574235.317315:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787574235.317461:0:6536:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003da1471b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787574235.317465:0:6536:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003da1471b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787574235.317467:0:6536:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003da1471b 4 00010000:00080000:0.0:1787574235.317491:0:6536:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000000d55ab9@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1787574235.319580:0:6536:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787574235.319801:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787574235.319843:0:6536:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787574235.319856:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd18a1efeeddb7a97 00000100:00080000:0.0:1787574235.319868:0:6536:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787574235.319874:0:6536:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000000d55ab9 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574235.319915:0:6536:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000458463ea x1874407346670080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574235.319933:0:6536:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787574235.322524:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000458463ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346670080:0@lo:38: 00000100:00100000:2.0:1787574235.322606:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574235.323206:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346670080 00000100:00100000:3.0:1787574235.323215:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346670080 00000100:00100000:3.0:1787574235.323276:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574235.323283:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005135ae0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346670080:12345-0@lo:38: 00000100:00100000:3.0:1787574235.323343:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005135ae0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346670080:12345-0@lo:38: Request processed in 59us (737us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787574235.323350:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574235.323598:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053bbfc63 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6536:1874407346670208:0@lo:502: 00000100:00100000:0.0:1787574235.323651:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574235.323678:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346670208 00000100:00100000:0.0:1787574235.323681:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346670208 00000100:00100000:0.0:1787574235.323713:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787574235.323727:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e1c602f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6536:x1874407346670208:12345-0@lo:502: 00000100:00100000:0.0:1787574235.323828:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e1c602f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6536:x1874407346670208:12345-0@lo:502: Request processed in 103us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574235.323836:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787574235.323891:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set 00000000994bcb5e going to sleep for 11 seconds 00000100:00100000:0.0:1787574235.323915:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053bbfc63 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6536:1874407346670208:0@lo:502: 00000040:00080000:0.0:1787574235.323940:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1787574235.324498:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574235.324506:0:3633:0:(import.c:65:import_set_state_nolock()) 0000000000d55ab9 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574235.324511:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787574235.324514:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000458463ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346670080:0@lo:38: 00000020:01000000:3.0:1787574235.327817:0:6486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787574235.327872:0:6486:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787574235.327898:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574235.327913:0:6486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787574235.327984:0:6486:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787574235.327986:0:6486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787574235.327987:0:6486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574235.327989:0:6486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574235.327990:0:6486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574235.327991:0:6486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574235.327993:0:6486:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787574235.327995:0:6486:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787574235.327996:0:6486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787574235.327997:0:6486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787574235.327999:0:6486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574235.328001:0:6486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787574235.328004:0:6486:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787574235.328007:0:6486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787574235.328015:0:6486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787574235.328016:0:6486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574235.328017:0:6486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574235.328018:0:6486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574235.328019:0:6486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574235.328020:0:6486:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787574235.328021:0:6486:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787574235.328022:0:6486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787574235.328022:0:6486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787574235.328023:0:6486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574235.328024:0:6486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787574235.328054:0:6486:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787574235.328074:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9d80956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346670336:0@lo:253: 00000100:00100000:3.0:1787574235.328153:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574235.328200:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074f61b0d going to sleep for 11 seconds 00000100:00100000:0.0:1787574235.328226:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346670336 00000100:00100000:0.0:1787574235.328234:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346670336 00000100:00100000:0.0:1787574235.328322:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787574235.328331:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b35233b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6486:x1874407346670336:12345-0@lo:253: 20000000:01000000:0.0:1787574235.328522:0:6501:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787574235.328538:0:6501:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787574235.340582:0:6501:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787574235.340604:0:6501:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787574235.340815:0:6525:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787574235.340821:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787574235.340841:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.340860:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f4cf2950/0xd18a1efeeddb7a6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a66 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.340868:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.340907:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f4cf2950/0xd18a1efeeddb7a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7a66 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.340921:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f4cf2950/0xd18a1efeeddb7a6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a66 expref: 12 pid: 6501 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574235.340934:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058a4424a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346670464:0@lo:104: 00000100:00100000:1.0:1787574235.341000:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574235.341067:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346670464 00000100:00100000:2.0:1787574235.341088:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346670464 00000100:00100000:2.0:1787574235.341133:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574235.341140:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c06ab0ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6525:x1874407346670464:12345-0@lo:104: 00010000:00010000:2.0:1787574235.341152:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574235.346826:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9d80956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6486:1874407346670336:0@lo:253: 10000000:01000000:3.0:1787574235.346849:0:6486:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787574235.346852:0:6486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787574235.346854:0:6486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787574235.346855:0:6486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574235.346856:0:6486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574235.346858:0:6486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574235.346859:0:6486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574235.346860:0:6486:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787574235.346862:0:6486:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787574235.346864:0:6486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787574235.346865:0:6486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787574235.346866:0:6486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574235.346868:0:6486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787574235.346885:0:6486:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787574235.350250:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b35233b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6486:x1874407346670336:12345-0@lo:253: Request processed in 21893us (22070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574235.350269:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574235.358147:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b545d120 going to sleep for 11 seconds 00010000:00010000:2.0:1787574235.360709:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787574235.360727:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c06ab0ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6525:x1874407346670464:12345-0@lo:104: Request processed in 19582us (19721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574235.360743:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574235.363775:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058a4424a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346670464:0@lo:104: 00010000:00010000:1.0:1787574235.363823:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.364321:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574235.364329:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.364338:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000016414bdd already unused, calling callback (00000000218a87f8) 10000000:00010000:1.0:1787574235.364341:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.364374:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574235.364381:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574235.364387:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574235.364439:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.364446:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574235.364471:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.364477:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 0000000016414bdd/0xd18a1efeeddb7a66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a6d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.364497:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574235.364499:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574235.364501:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574235.364620:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058a4424a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346670592:0@lo:103: 00000100:00100000:2.0:1787574235.364693:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574235.365495:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346670592 00000100:00100000:1.0:1787574235.365506:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346670592 00010000:00010000:1.0:1787574235.365554:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f4cf2950/0xd18a1efeeddb7a6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a66 expref: 12 pid: 6501 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574235.365585:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574235.365594:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aaaba052 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:3635:x1874407346670592:12345-0@lo:103: 00010000:00010000:1.0:1787574235.365606:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574235.365611:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f4cf2950/0xd18a1efeeddb7a6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a66 expref: 12 pid: 6501 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365629:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f4cf2950/0xd18a1efeeddb7a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a66 expref: 12 pid: 6501 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365646:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f4cf2950/0xd18a1efeeddb7a6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7a66 expref: 12 pid: 6501 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365662:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365669:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787574235.365684:0:6494:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024863812s 00010000:00010000:1.0:1787574235.365688:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365694:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365699:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365705:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365711:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007079dcfa already unused, calling callback (00000000b88c46cf) 00010000:00010000:1.0:1787574235.365714:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365720:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365741:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365750:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574235.365800:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aaaba052 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:3635:x1874407346670592:12345-0@lo:103: Request processed in 208us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574235.365808:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787574235.365829:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365836:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574235.365841:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007079dcfa/0xd18a1efeeddb7a9e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574235.370106:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058a4424a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346670592:0@lo:103: 00080000:10000000:3.0:1787574235.379711:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1787574235.381738:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787574235.383940:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1787574235.384140:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787574235.385036:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1787574235.385207:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787574235.388877:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1787574235.389076:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787574235.389301:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1787574235.389460:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787574235.389668:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1787574235.389822:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1787574235.401489:0:6486:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787574235.420481:0:6486:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787574235.420739:0:6541:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787574235.420745:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787574235.430118:0:6542:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787574235.437667:0:6486:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787574235.438107:0:6542:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574235.440226:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787574235.443171:0:6486:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787574235.443196:0:6486:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787574235.443499:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574235.449937:0:6542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787574235.450053:0:6542:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787574235.450067:0:6542:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1787574235.450948:0:6486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787574235.451677:0:6486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787574235.451721:0:6486:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787574235.452290:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787574235.452662:0:6486:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1787574235.453473:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787574235.453625:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787574235.453780:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787574235.453918:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787574235.454061:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787574235.454210:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787574235.454394:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787574235.454553:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787574235.454698:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787574235.454841:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787574235.454996:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787574235.455136:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787574235.455311:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787574235.455447:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787574235.455607:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787574235.455734:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787574235.456034:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787574235.456185:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787574235.456349:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787574235.463501:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787574235.463937:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787574235.464396:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787574235.464549:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787574235.464683:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787574235.465515:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787574235.465726:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787574235.466405:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787574235.466566:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787574235.466687:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787574235.468695:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787574235.470627:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787574235.472360:0:6486:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787574235.472682:0:6486:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787574235.481638:0:6486:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787574235.481674:0:6486:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7bcc1c47988 00100000:10000000:2.0:1787574235.481682:0:6486:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787574235.482932:0:6486:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787574235.482947:0:6486:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787574235.482963:0:6486:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787574235.482977:0:6486:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787574235.484715:0:6486:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787574235.484875:0:6486:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787574235.826021:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574236.849591:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574237.873355:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574238.901503:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574239.924758:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787574240.423876:0:6787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787574240.497768:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787574240.497777:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787574240.497780:0:38:0:(import.c:65:import_set_state_nolock()) 0000000000d55ab9 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574240.497791:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000000d55ab9 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574240.497808:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002ec9f651 x1874407346670848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574240.497843:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec9f651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346670848:0@lo:38: 00000100:00100000:3.0:1787574240.497915:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574240.498160:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9d80956 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346670720:0@lo:400: 00000100:00100000:1.0:1787574240.498194:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574240.498321:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346670720 00000100:00100000:3.0:1787574240.498328:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346670720 00000100:00100000:3.0:1787574240.498383:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574240.498390:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000675b5280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:3636:x1874407346670720:12345-0@lo:400: 00000100:00100000:3.0:1787574240.498434:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000675b5280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:3636:x1874407346670720:12345-0@lo:400: Request processed in 45us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574240.498440:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574240.498477:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9d80956 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346670720:0@lo:400: 00000100:00100000:0.0:1787574240.498777:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346670848 00000100:00100000:0.0:1787574240.498781:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346670848 00000100:00100000:0.0:1787574240.498805:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574240.498809:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff18e72e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874407346670848:12345-0@lo:38: 00010000:00080000:0.0:1787574240.498830:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1787574240.498874:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd18a1efeeddb7aa5 00000004:00100000:0.0:1787574240.498921:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574240.499061:0:6511:0:(import.c:65:import_set_state_nolock()) 00000000db17a4a1 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574240.499107:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff18e72e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874407346670848:12345-0@lo:38: Request processed in 296us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574240.499113:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787574240.499326:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002ec9f651 x1874407346670848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787574240.499340:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787574240.499346:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787574240.499350:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787574240.499353:0:3633:0:(import.c:65:import_set_state_nolock()) 0000000000d55ab9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787574240.499357:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec9f651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346670848:0@lo:38: 00010000:00010000:2.0:1787574240.945733:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787574241.528529:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787574241.528538:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca5109bd800 from 3 10000000:01000000:0.0:1787574241.528543:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787574241.528589:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574241.528613:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574241.528623:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574241.528647:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053bbfc63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346670976:0@lo:101: 00000100:00100000:0.0:1787574241.528715:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574241.528761:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030917730 going to sleep for 11 seconds 00000100:00100000:1.0:1787574241.529221:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346670976 00000100:00100000:1.0:1787574241.529230:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346670976 00000100:00100000:1.0:1787574241.529325:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787574241.529334:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bd8e6f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:6506:x1874407346670976:12345-0@lo:101: 00010000:00010000:1.0:1787574241.529346:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574241.529360:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7ab3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7aac expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574241.529391:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7aac expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574241.529402:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7aac expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574241.529421:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d6a2127, rc 0) 00000100:00100000:0.0:1787574241.529503:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bd8e6f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6506:x1874407346670976:12345-0@lo:101: Request processed in 170us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574241.529520:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787574241.529596:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053bbfc63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346670976:0@lo:101: 00010000:00010000:2.0:1787574241.529613:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574241.529621:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574241.529692:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066c7b499 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346671104:0@lo:256: 00000100:00100000:2.0:1787574241.529730:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574241.529762:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000002c411b38 going to sleep for 11 seconds 00000100:00100000:1.0:1787574241.530082:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346671104 00000100:00100000:1.0:1787574241.530088:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346671104 00000100:00100000:1.0:1787574241.530123:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787574241.530129:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3024036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6506:x1874407346671104:12345-0@lo:256: 20000000:01000000:1.0:1787574241.530145:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787574241.530161:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787574241.530164:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787574241.530320:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3024036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:6506:x1874407346671104:12345-0@lo:256: Request processed in 191us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574241.530327:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787574241.530518:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066c7b499 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346671104:0@lo:256: 10000000:01000000:2.0:1787574241.530567:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574241.530573:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574241.530581:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1787574241.608220:0:6839:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574241.609032:0:6839:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574241.970593:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574242.999420:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574244.017473:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787574244.710784:0:6941:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787574244.710974:0:6941:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787574245.063200:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574245.617741:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9d80956 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346671232:0@lo:400: 00000100:00100000:1.0:1787574245.617822:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574245.618402:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0affae3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346671360:0@lo:400: 00000100:00100000:3.0:1787574245.618441:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574245.618491:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346671360 00000100:00100000:3.0:1787574245.618499:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346671360 00000100:00100000:3.0:1787574245.618541:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574245.618549:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001aa897c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346671360:12345-0@lo:400: 00000100:00100000:2.0:1787574245.618698:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346671232 00000100:00100000:2.0:1787574245.618704:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346671232 00000100:00100000:2.0:1787574245.618737:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787574245.618743:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024cb9cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:3637:x1874407346671232:12345-0@lo:400: 00000100:00100000:2.0:1787574245.620111:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024cb9cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:3637:x1874407346671232:12345-0@lo:400: Request processed in 1361us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574245.620124:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574245.620264:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9d80956 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346671232:0@lo:400: 00000100:00100000:3.0:1787574245.620738:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001aa897c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346671360:12345-0@lo:400: Request processed in 2188us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574245.620747:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787574245.621096:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d0affae3 x1874407346671360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574245.621110:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0affae3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346671360:0@lo:400: 00010000:00010000:2.0:1787574246.068201:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574247.089454:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574248.116629:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574249.140160:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574250.161402:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574250.744082:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066c7b499 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346671488:0@lo:400: 00000100:00100000:2.0:1787574250.744171:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574250.744271:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0c5892f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346671616:0@lo:400: 00000100:00100000:2.0:1787574250.744315:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574250.745336:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346671616 00000100:00100000:2.0:1787574250.745348:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346671616 00000100:00100000:2.0:1787574250.745395:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787574250.745404:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f13c5d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346671616:12345-0@lo:400: 00000100:00100000:2.0:1787574250.745472:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f13c5d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346671616:12345-0@lo:400: Request processed in 69us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574250.745480:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787574250.745519:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a0c5892f x1874407346671616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574250.745533:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0c5892f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346671616:0@lo:400: 00000100:00100000:1.0:1787574250.745845:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346671488 00000100:00100000:1.0:1787574250.745851:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346671488 00000100:00100000:1.0:1787574250.745894:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787574250.745901:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076684918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:3635:x1874407346671488:12345-0@lo:400: 00000100:00100000:1.0:1787574250.745948:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076684918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:3635:x1874407346671488:12345-0@lo:400: Request processed in 48us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574250.745954:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787574250.746115:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066c7b499 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346671488:0@lo:400: 00010000:00010000:1.0:1787574251.192349:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574252.223569:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574253.236552:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574254.257397:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787574255.098631:0:7439:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787574255.098636:0:7439:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787574255.098637:0:7439:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787574255.098764:0:7439:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000045e756b1 00000020:01000004:0.0:1787574255.099401:0:7439:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1787574255.099412:0:7439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787574255.099427:0:7439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000b898569a) 00000020:00000080:0.0:1787574255.099443:0:7439:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787574255.163558:0:7439:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1787574255.163636:0:7439:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1787574255.197691:0:7439:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787574255.198002:0:7439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787574255.198014:0:7439:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787574255.198026:0:7439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb7ac1 00000020:01000004:0.0:1787574255.198032:0:7439:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787574255.198053:0:7439:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787574255.198056:0:7439:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787574255.198068:0:7439:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787574255.198107:0:7439:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787574255.198112:0:7439:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787574255.217941:0:7439:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787574255.217981:0:7439:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1787574255.217985:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787574255.217987:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787574255.217988:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574255.217990:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574255.217991:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574255.217992:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574255.217993:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787574255.217994:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787574255.217996:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787574255.217998:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574255.217999:0:7439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787574255.218002:0:7439:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1787574255.218005:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787574255.218006:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787574255.218007:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574255.218008:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574255.218009:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574255.218010:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574255.218011:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787574255.218012:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787574255.218012:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787574255.218013:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574255.218014:0:7439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787574255.218040:0:7439:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787574255.218057:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e8c8044 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346671744:0@lo:253: 00000100:00100000:0.0:1787574255.218126:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.218209:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 000000008abcc7c1 going to sleep for 11 seconds 00000100:00100000:1.0:1787574255.218435:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346671744 00000100:00100000:1.0:1787574255.218450:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346671744 00000100:00100000:1.0:1787574255.218505:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574255.218514:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082e7144a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:7439:x1874407346671744:12345-0@lo:253: 20000000:01000000:1.0:1787574255.218618:0:6503:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787574255.218623:0:6503:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1787574255.218628:0:6503:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1787574255.218631:0:6503:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1787574255.218664:0:6503:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1787574255.219136:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574255.219447:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787574255.219461:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787574255.219479:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1787574255.219494:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1787574255.219508:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1787574255.219636:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1787574255.219645:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1787574255.219658:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1787574255.219663:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1787574255.219674:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1787574255.219679:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1787574255.220090:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1787574255.220113:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1787574255.220410:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1787574255.220422:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:1.0:1787574255.220435:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1787574255.220442:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787574255.220453:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1787574255.220458:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:1.0:1787574255.220469:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1787574255.220475:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787574255.220486:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1787574255.220514:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1787574255.220523:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1787574255.221114:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1787574255.221126:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1787574255.221138:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1787574255.221154:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1787574255.221291:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1787574255.221299:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1787574255.221312:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787574255.221420:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787574255.221426:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1787574255.221448:0:6503:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787574255.221455:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1787574255.225551:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787574255.225815:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787574255.225842:0:6503:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.140@tcp for mdt 20000000:01000000:2.0:1787574255.225844:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:2.0:1787574255.225860:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787574255.225866:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787574255.225878:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787574255.225883:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:2.0:1787574255.225897:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787574255.225904:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1787574255.225916:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1787574255.225929:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1787574255.225982:0:6503:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1787574255.225991:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1787574255.226610:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1787574255.226901:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787574255.226919:0:6503:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.140@tcp for mdt 20000000:01000000:1.0:1787574255.226921:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:1.0:1787574255.226936:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787574255.226942:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787574255.226955:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787574255.226961:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:1.0:1787574255.226972:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787574255.226979:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1787574255.226991:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787574255.227007:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1787574255.227025:0:6503:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787574255.227028:0:6503:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787574255.227031:0:6503:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787574255.227075:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787574255.227076:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787574255.227945:0:7447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787574255.227978:0:7447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787574255.227993:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787574255.230376:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787574255.230409:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787574255.230434:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787574255.230445:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787574255.230447:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787574255.230906:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787574255.230921:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787574255.230932:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787574255.231858:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1787574255.231886:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1787574255.231902:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1787574255.231910:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787574255.231912:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787574255.233143:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787574255.233175:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787574255.233190:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1787574255.234720:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787574255.234737:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787574255.234746:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1787574255.234755:0:6503:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787574255.234757:0:6503:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787574255.234761:0:6503:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787574255.234766:0:6503:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787574255.235560:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1787574255.236401:0:6503:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787574255.248125:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787574255.248421:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.248442:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb79fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb79f6 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.248461:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a12 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.248466:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b2e37f41/0xd18a1efeeddb7a89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a82 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.248473:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.248515:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b2e37f41/0xd18a1efeeddb7a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7a82 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.248782:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b2e37f41/0xd18a1efeeddb7a89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a82 expref: 12 pid: 6504 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.248801:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e096cbad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1874407346671872:0@lo:104: 00000100:00100000:0.0:1787574255.248868:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574255.252696:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7a12 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.252716:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7a19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a12 expref: 12 pid: 6504 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.252732:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e83da071 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1874407346672000:0@lo:104: 00000100:00100000:0.0:1787574255.252789:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.252858:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346671872 00000100:00100000:0.0:1787574255.252867:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346671872 00000100:00100000:0.0:1787574255.252911:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346672000 00000100:00100000:0.0:1787574255.252914:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346672000 00000100:00100000:0.0:1787574255.252961:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574255.252969:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072514252 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6503:x1874407346671872:12345-0@lo:104: 00010000:00010000:0.0:1787574255.252981:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.253027:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574255.253032:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072514252 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6503:x1874407346671872:12345-0@lo:104: Request processed in 66us (4166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.253039:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574255.253055:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574255.253060:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008946474b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6503:x1874407346672000:12345-0@lo:104: 00010000:00010000:0.0:1787574255.253066:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.253090:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787574255.253093:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008946474b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6503:x1874407346672000:12345-0@lo:104: Request processed in 34us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.253099:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787574255.253112:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574255.253116:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.253123:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000099e148b9 already unused, calling callback (00000000218a87f8) 10000000:00010000:0.0:1787574255.253126:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.253133:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574255.253148:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574255.253154:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574255.254308:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.254592:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574255.254623:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.254630:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 0000000099e148b9/0xd18a1efeeddb7a82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a89 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.254643:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574255.254646:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.254651:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001930c3ba already unused, calling callback (00000000218a87f8) 10000000:00010000:0.0:1787574255.254653:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.254659:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574255.254664:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574255.254670:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574255.254692:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.254698:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787574255.254712:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787574255.254713:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.254718:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 000000001930c3ba/0xd18a1efeeddb7a12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a19 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.254726:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574255.254728:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574255.254729:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006756c65e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346672128:0@lo:103: 00010000:00010000:0.0:1787574255.254729:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574255.254734:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574255.254747:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574255.254754:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6af0108 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346672256:0@lo:103: 00000100:00100000:0.0:1787574255.254785:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.254830:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574255.254867:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb79fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb79f6 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.254877:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb79fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb79f6 expref: 12 pid: 6501 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.254886:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0b023e6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1874407346672384:0@lo:104: 00000100:00100000:0.0:1787574255.254909:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.254943:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346672384 00000100:00100000:0.0:1787574255.254948:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346672384 00000100:00100000:0.0:1787574255.254985:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574255.254992:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006941e92e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6503:x1874407346672384:12345-0@lo:104: 00010000:00010000:0.0:1787574255.255008:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.255043:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574255.255047:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006941e92e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6503:x1874407346672384:12345-0@lo:104: Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.255053:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787574255.255069:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574255.255071:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.255077:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000c51bf79 already unused, calling callback (00000000218a87f8) 10000000:00010000:0.0:1787574255.255078:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.255084:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574255.255089:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574255.255094:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574255.255109:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.255115:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574255.255123:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.255128:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 000000000c51bf79/0xd18a1efeeddb79f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb79fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.255146:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574255.255148:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574255.255149:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574255.255379:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346672256 00000100:00100000:3.0:1787574255.255384:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346672256 00010000:00010000:3.0:1787574255.255404:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7a19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a12 expref: 13 pid: 6504 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574255.255423:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346672128 00000100:00100000:3.0:1787574255.255426:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346672128 00010000:00010000:3.0:1787574255.255436:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b2e37f41/0xd18a1efeeddb7a89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a82 expref: 14 pid: 6504 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574255.255449:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574255.255454:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006dbd9ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:3635:x1874407346672256:12345-0@lo:103: 00010000:00010000:3.0:1787574255.255463:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574255.255468:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7a19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a12 expref: 14 pid: 6504 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.255476:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7a19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a12 expref: 14 pid: 6504 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.255492:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574255.255515:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006dbd9ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:3635:x1874407346672256:12345-0@lo:103: Request processed in 62us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574255.255532:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574255.255546:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574255.255550:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efde72c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:3636:x1874407346672128:12345-0@lo:103: 00010000:00010000:3.0:1787574255.255557:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574255.255560:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b2e37f41/0xd18a1efeeddb7a89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a82 expref: 13 pid: 6504 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.255568:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b2e37f41/0xd18a1efeeddb7a89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a82 expref: 13 pid: 6504 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.255577:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574255.255601:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efde72c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:3636:x1874407346672128:12345-0@lo:103: Request processed in 51us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574255.255607:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574255.255881:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574255.255896:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c8f7094 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346672512:0@lo:103: 00000100:00100000:3.0:1787574255.255924:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574255.255992:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346672512 00000100:00100000:1.0:1787574255.255997:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346672512 00010000:00010000:1.0:1787574255.256013:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb79fd lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb79f6 expref: 13 pid: 6501 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574255.256027:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787574255.256032:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cefc7143 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:3634:x1874407346672512:12345-0@lo:103: 00010000:00010000:1.0:1787574255.256040:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574255.256043:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb79fd lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb79f6 expref: 13 pid: 6501 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.256051:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb79fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb79f6 expref: 13 pid: 6501 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.256062:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.256075:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.256088:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.256093:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.256098:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.256103:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.256108:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000033b157ee already unused, calling callback (00000000b88c46cf) 00010000:00010000:1.0:1787574255.256111:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.256117:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.256764:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006756c65e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346672128:0@lo:103: 00000100:00100000:0.0:1787574255.256795:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6af0108 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346672256:0@lo:103: 00000100:00100000:0.0:1787574255.256815:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000107ed842 going to sleep for 11 seconds 00010000:00010000:0.0:1787574255.256827:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b2e37f41/0xd18a1efeeddb7a89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7a82 expref: 13 pid: 6504 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.256839:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e096cbad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1874407346671872:0@lo:104: 00010000:00010000:0.0:1787574255.256848:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7a19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7a12 expref: 12 pid: 6504 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.256856:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e83da071 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1874407346672000:0@lo:104: 00010000:00010000:0.0:1787574255.256863:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb79fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb79f6 expref: 11 pid: 6501 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.256871:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0b023e6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1874407346672384:0@lo:104: 00010000:00010000:0.0:1787574255.260434:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x54a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.260439:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.260454:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.260459:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574255.260459:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.260480:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000033b157ee/0xd18a1efeeddb7ac8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787574255.260501:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787574255.260538:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cefc7143 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+10:3634:x1874407346672512:12345-0@lo:103: Request processed in 4502us (4610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.260548:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574255.260646:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c8f7094 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346672512:0@lo:103: 00000100:00100000:0.0:1787574255.266738:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082e7144a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:7439:x1874407346671744:12345-0@lo:253: Request processed in 48217us (48603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.266754:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787574255.266761:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e8c8044 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346671744:0@lo:253: 10000000:01000000:3.0:1787574255.266920:0:7439:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787574255.266924:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787574255.266926:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787574255.266927:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574255.266929:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1787574255.266930:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574255.266931:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574255.266933:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787574255.266934:0:7439:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787574255.266935:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574255.267087:0:7439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787574255.267109:0:7439:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000045e756b1 from lustre-MDT0001 10000000:01000000:3.0:1787574255.267141:0:7439:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787574255.267144:0:7439:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787574255.267151:0:7439:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ca5050d4d28 local copy 10000000:01000000:3.0:1787574255.267154:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787574255.267390:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.267401:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.267409:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574255.267426:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c80c8809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346672640:0@lo:101: 00000100:00100000:3.0:1787574255.267466:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574255.267566:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000feb47420 going to sleep for 11 seconds 00000100:00100000:2.0:1787574255.267650:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346672640 00000100:00100000:2.0:1787574255.267658:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346672640 00000100:00100000:2.0:1787574255.267746:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787574255.267755:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091ca78c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:7439:x1874407346672640:12345-0@lo:101: 00010000:00010000:2.0:1787574255.267768:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574255.267790:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb7ad6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7acf expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574255.267811:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb7ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7acf expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574255.267821:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb7ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7acf expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574255.267829:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e9c32a6, rc 0) 00000100:00100000:2.0:1787574255.267870:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091ca78c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+10:7439:x1874407346672640:12345-0@lo:101: Request processed in 116us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574255.267888:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787574255.267959:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c80c8809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346672640:0@lo:101: 00010000:00010000:3.0:1787574255.267973:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.267980:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574255.268066:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c80c8809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346672768:0@lo:501: 00000100:00100000:3.0:1787574255.268092:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574255.273993:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000feb47420 going to sleep for 11 seconds 00000100:00100000:0.0:1787574255.276783:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346672768 00000100:00100000:0.0:1787574255.276801:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346672768 00000100:00100000:0.0:1787574255.276865:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787574255.276874:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008ed3f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+10:7439:x1874407346672768:12345-0@lo:501: 00000100:00100000:0.0:1787574255.277023:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008ed3f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+10:7439:x1874407346672768:12345-0@lo:501: Request processed in 150us (8931us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787574255.277031:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787574255.277071:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c80c8809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346672768:0@lo:501: 10000000:01000000:3.0:1787574255.277097:0:7439:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787574255.277135:0:7439:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787574255.277141:0:7439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.277149:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.277167:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.277189:0:7439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787574255.277215:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca526758000 00010000:00010000:0.0:1787574255.277215:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1787574255.277219:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787574255.277220:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574255.277224:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ca5050d4d28 10000000:01000000:3.0:1787574255.277227:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1787574255.277227:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a6ec9a95 already unused, calling callback (00000000218a87f8) 10000000:00010000:0.0:1787574255.277229:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574255.277230:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ca5050d4d28 from 1 10000000:01000000:3.0:1787574255.277232:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787574255.277237:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574255.277269:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574255.277285:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574255.277305:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.277311:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574255.277376:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000f4cf2950/0xd18a1efeeddb7add lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.277383:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000f4cf2950/0xd18a1efeeddb7add lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.277391:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000f4cf2950/0xd18a1efeeddb7add lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.277397:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.277402:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 00000000a6ec9a95/0xd18a1efeeddb7acf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd18a1efeeddb7ad6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574255.277405:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c80c8809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673024:0@lo:101: 00010000:00010000:0.0:1787574255.277419:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574255.277420:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574255.277422:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574255.277430:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0b023e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346672896:0@lo:103: 00000100:00100000:3.0:1787574255.277436:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.277454:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574255.277462:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 000000002aee17b5 going to sleep for 11 seconds 00000100:00100000:0.0:1787574255.277484:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346672896 00000100:00100000:0.0:1787574255.277488:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346672896 00000100:00100000:0.0:1787574255.277584:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574255.277591:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787574255.277603:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787574255.277604:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e83da071 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+10:3636:x1874407346672896:12345-0@lo:103: 00010000:00010000:0.0:1787574255.277613:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574255.277627:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e9c32a6/0xd18a1efeeddb7ad6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7acf expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.277640:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574255.277667:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e83da071 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:3636:x1874407346672896:12345-0@lo:103: Request processed in 75us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.277673:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574255.277871:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0b023e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346672896:0@lo:103: 00000100:00100000:0.0:1787574255.277889:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346673024 00000100:00100000:0.0:1787574255.277892:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346673024 00000100:00100000:0.0:1787574255.277910:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787574255.277915:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ae39f46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:7439:x1874407346673024:12345-0@lo:101: 00010000:00010000:0.0:1787574255.277922:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574255.277999:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7ae4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7add expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.278017:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7ae4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7add expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.278024:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049ab38bd/0xd18a1efeeddb7ae4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7add expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.278028:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049ab38bd, rc 0) 00000100:00100000:0.0:1787574255.278055:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ae39f46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+10:7439:x1874407346673024:12345-0@lo:101: Request processed in 140us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.278061:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787574255.278087:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c80c8809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673024:0@lo:101: 00010000:00010000:3.0:1787574255.278098:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000f4cf2950/0xd18a1efeeddb7add lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ae4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.278105:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000f4cf2950/0xd18a1efeeddb7add lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7ae4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574255.278119:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787574255.278132:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000f4cf2950/0xd18a1efeeddb7add lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ae4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.278138:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000f4cf2950/0xd18a1efeeddb7add lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ae4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574255.278146:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ca526758000 10000000:01000000:3.0:1787574255.278149:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787574255.278152:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ca526758000 from 1 10000000:01000000:3.0:1787574255.278217:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787574255.278233:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000d222d847/0xd18a1efeeddb7aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.278268:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000d222d847/0xd18a1efeeddb7aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.278275:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000d222d847/0xd18a1efeeddb7aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.281372:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574255.282581:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c80c8809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673152:0@lo:101: 00000100:00100000:3.0:1787574255.282717:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574255.282782:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 000000002aee17b5 going to sleep for 11 seconds 00000100:00100000:1.0:1787574255.282858:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346673152 00000100:00100000:1.0:1787574255.282873:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346673152 00000100:00100000:1.0:1787574255.282930:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787574255.282947:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000701a8951 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+10:7439:x1874407346673152:12345-0@lo:101: 00010000:00010000:1.0:1787574255.282962:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574255.282978:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000020eb9d97/0xd18a1efeeddb7af2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7aeb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.283001:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000020eb9d97/0xd18a1efeeddb7af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7aeb expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.283010:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000020eb9d97/0xd18a1efeeddb7af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7aeb expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.283018:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000020eb9d97, rc 0) 00000100:00100000:1.0:1787574255.283066:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000701a8951 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:7439:x1874407346673152:12345-0@lo:101: Request processed in 129us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.283072:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574255.283095:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c80c8809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673152:0@lo:101: 00010000:00010000:2.0:1787574255.283109:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000d222d847/0xd18a1efeeddb7aeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574255.283118:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000d222d847/0xd18a1efeeddb7aeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574255.283134:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787574255.283151:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000d222d847/0xd18a1efeeddb7aeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574255.283159:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000d222d847/0xd18a1efeeddb7aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574255.283167:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787574255.283171:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787574255.283177:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ca526758000 10000000:01000000:2.0:1787574255.283179:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787574255.283183:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787574255.283185:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787574255.283207:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000b2e37f41/0xd18a1efeeddb7af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574255.283214:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000b2e37f41/0xd18a1efeeddb7af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574255.283220:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000b2e37f41/0xd18a1efeeddb7af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574255.283273:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0c5892f pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673280:0@lo:101: 00000100:00100000:2.0:1787574255.283301:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574255.283324:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 0000000016f88082 going to sleep for 11 seconds 00000100:00100000:3.0:1787574255.283380:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346673280 00000100:00100000:3.0:1787574255.283386:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346673280 00000100:00100000:3.0:1787574255.283407:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787574255.283413:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+11:7439:x1874407346673280:12345-0@lo:101: 00010000:00010000:3.0:1787574255.283419:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574255.283427:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c84a0418/0xd18a1efeeddb7b00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7af9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.283439:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c84a0418/0xd18a1efeeddb7b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7af9 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.283447:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c84a0418/0xd18a1efeeddb7b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7af9 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.283453:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c84a0418, rc 0) 00000100:00100000:3.0:1787574255.283489:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:7439:x1874407346673280:12345-0@lo:101: Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574255.283494:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574255.283643:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0c5892f pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673280:0@lo:101: 00010000:00010000:2.0:1787574255.283652:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000b2e37f41/0xd18a1efeeddb7af9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574255.283659:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000b2e37f41/0xd18a1efeeddb7af9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574255.283911:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673408:0@lo:501: 00000100:00100000:3.0:1787574255.283941:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574255.283966:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000acf4a841 going to sleep for 11 seconds 00000100:00100000:0.0:1787574255.283986:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346673408 00000100:00100000:0.0:1787574255.283991:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346673408 00000100:00100000:0.0:1787574255.284024:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787574255.284030:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000aced036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:7439:x1874407346673408:12345-0@lo:501: 00000100:00100000:0.0:1787574255.284137:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000aced036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:7439:x1874407346673408:12345-0@lo:501: Request processed in 107us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.284144:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574255.284161:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673408:0@lo:501: 00000100:00100000:3.0:1787574255.284187:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673536:0@lo:503: 00000100:00100000:3.0:1787574255.284225:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574255.284269:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000acf4a841 going to sleep for 11 seconds 00000100:00100000:2.0:1787574255.284332:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346673536 00000100:00100000:2.0:1787574255.284336:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346673536 00000100:00100000:2.0:1787574255.284356:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574255.284362:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e867c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:7439:x1874407346673536:12345-0@lo:503: 00000100:00100000:2.0:1787574255.284439:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e867c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:7439:x1874407346673536:12345-0@lo:503: Request processed in 77us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574255.284446:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787574255.284606:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673536:0@lo:503: 00000040:00080000:3.0:1787574255.284997:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574255.285063:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673664:0@lo:502: 00000100:00100000:3.0:1787574255.285087:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574255.285110:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000acf4a841 going to sleep for 11 seconds 00000100:00100000:1.0:1787574255.285133:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346673664 00000100:00100000:1.0:1787574255.285138:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346673664 00000100:00100000:1.0:1787574255.285394:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787574255.285402:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d6c8e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:7439:x1874407346673664:12345-0@lo:502: 00000100:00100000:1.0:1787574255.285484:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d6c8e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:7439:x1874407346673664:12345-0@lo:502: Request processed in 84us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.285490:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787574255.285562:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673664:0@lo:502: 00000040:00080000:3.0:1787574255.285741:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787574255.285759:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1787574255.285766:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1787574255.285786:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1787574255.285794:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1787574255.285800:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1787574255.285807:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1787574255.285813:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1787574255.285820:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1787574255.285829:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1787574255.285843:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1787574255.285854:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1787574255.285866:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1787574255.285891:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1787574255.285902:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1787574255.285908:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1787574255.285915:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1787574255.285921:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1787574255.285940:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1787574255.285954:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1787574255.285967:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1787574255.285979:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1787574255.285991:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1787574255.286010:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673792:0@lo:502: 00000100:00100000:3.0:1787574255.286037:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574255.286062:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000acf4a841 going to sleep for 11 seconds 00000100:00100000:2.0:1787574255.288088:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346673792 00000100:00100000:2.0:1787574255.288099:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346673792 00000100:00100000:2.0:1787574255.288155:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787574255.288164:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037de5a10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:7439:x1874407346673792:12345-0@lo:502: 00000100:00100000:2.0:1787574255.288374:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037de5a10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:7439:x1874407346673792:12345-0@lo:502: Request processed in 211us (2335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574255.288382:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787574255.289513:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346673792:0@lo:502: 00000040:00080000:3.0:1787574255.290233:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1787574255.290292:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1787574255.291026:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574255.291037:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574255.291039:0:7452:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787574255.291044:0:7452:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787574255.291047:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787574255.291060:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000ec1984c4) 00000020:00000080:3.0:1787574255.291081:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1787574255.291086:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787574255.291162:0:7452:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787574255.291171:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb7b0e 00000020:00000080:3.0:1787574255.291554:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787574255.291559:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574255.291562:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574255.291564:0:7452:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787574255.291566:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574255.291569:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574255.291570:0:7452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787574255.291573:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787574255.291587:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000a460da67) 00000020:00000080:3.0:1787574255.291616:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1787574255.291621:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787574255.291623:0:7452:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787574255.291626:0:7452:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787574255.291631:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787574255.291682:0:7452:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000045e756b1 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787574255.291694:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000083559721) 00000020:00000080:3.0:1787574255.291702:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1787574255.291759:0:7452:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787574255.291764:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb7b23 00000020:00000080:3.0:1787574255.291877:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787574255.291887:0:7452:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787574255.291891:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd18a1efeeddb7b2a 00080000:01000000:3.0:1787574255.291896:0:7452:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787574255.291899:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb7b31 00080000:10000000:3.0:1787574255.292441:0:7452:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787574255.292560:0:7452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1787574255.400417:0:7452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1787574255.400646:0:7452:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787574255.404695:0:7452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787574255.405677:0:7452:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787574255.418414:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787574255.418430:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574255.418436:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574255.418439:0:7452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787574255.418442:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574255.418448:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574255.418450:0:7452:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787574255.418452:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787574255.418458:0:7452:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:2.0:1787574255.418488:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574255.418502:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000025672e0b) 00000020:00000080:2.0:1787574255.418527:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787574255.418532:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787574255.418630:0:7452:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787574255.418637:0:7452:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787574255.418645:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb7b3f 00010000:00080000:2.0:1787574255.418674:0:7452:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000069702c9c@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1787574255.424106:0:7452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1787574255.426473:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787574255.426488:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787574255.426528:0:7452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787574255.426552:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb7b46 00000100:00080000:1.0:1787574255.426563:0:7452:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574255.426578:0:7452:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000069702c9c using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574255.426608:0:7452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ff711fb2 x1874407346673920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574255.426632:0:7452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787574255.426690:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574255.426693:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574255.426694:0:7452:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787574255.426696:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787574255.426698:0:7452:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787574255.426699:0:7452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574255.426700:0:7452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574255.426701:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787574255.426702:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574255.426703:0:7452:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787574255.426704:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574255.426707:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574255.426708:0:7452:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787574255.426710:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787574255.426730:0:7452:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787574255.426737:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574255.426738:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574255.426739:0:7452:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787574255.426740:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574255.426742:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574255.426742:0:7452:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787574255.426744:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574255.426745:0:7452:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787574255.426767:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574255.426768:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574255.426769:0:7452:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787574255.426772:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1787574255.426953:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0c5892f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346674048:0@lo:400: 00000100:00100000:2.0:1787574255.427024:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574255.427104:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346674048 00000100:00100000:2.0:1787574255.427111:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346674048 00000100:00100000:2.0:1787574255.427168:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574255.427178:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070efc844 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346674048:12345-0@lo:400: 00000100:00100000:2.0:1787574255.427227:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070efc844 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346674048:12345-0@lo:400: Request processed in 52us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574255.427233:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574255.427449:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff711fb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346673920:0@lo:38: 00000100:00100000:0.0:1787574255.427497:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787574255.427545:0:7439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1787574255.427577:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787574255.427597:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000b2e37f41/0xd18a1efeeddb7af9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.427607:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000b2e37f41/0xd18a1efeeddb7af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574255.427614:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca526758000 from 1 10000000:01000000:0.0:1787574255.427617:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787574255.427642:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.427649:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.427659:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.427673:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e096cbad pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674176:0@lo:101: 00000100:00100000:0.0:1787574255.427703:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.427717:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000736ff06d going to sleep for 11 seconds 00010000:00080000:2.0:1787574255.427818:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a0c5892f x1874407346674048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574255.427917:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0c5892f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346674048:0@lo:400: 00000100:00100000:1.0:1787574255.428491:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346674176 00000100:00100000:1.0:1787574255.428505:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346674176 00000100:00100000:1.0:1787574255.428537:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574255.428544:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee6747f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+12:7439:x1874407346674176:12345-0@lo:101: 00010000:00010000:1.0:1787574255.428554:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574255.428565:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005663ca29/0xd18a1efeeddb7b54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7b4d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.428586:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005663ca29/0xd18a1efeeddb7b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b4d expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.428595:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005663ca29/0xd18a1efeeddb7b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b4d expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.428602:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005663ca29, rc 0) 00000100:00100000:1.0:1787574255.428645:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee6747f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:7439:x1874407346674176:12345-0@lo:101: Request processed in 102us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.428653:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574255.428688:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e096cbad pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674176:0@lo:101: 00010000:00010000:1.0:1787574255.428701:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.428710:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574255.430591:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346673920 00000100:00100000:2.0:1787574255.430606:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346673920 00000100:00100000:2.0:1787574255.430655:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574255.430662:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0b023e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1874407346673920:12345-0@lo:38: 00010000:00080000:2.0:1787574255.430691:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1787574255.430728:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb7b5b 00000004:00100000:2.0:1787574255.430743:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787574255.430748:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787574255.431059:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bdeef217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674304:0@lo:256: 00000100:00100000:1.0:1787574255.431125:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574255.431452:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2e1bf9d going to sleep for 11 seconds 00000100:00100000:2.0:1787574255.431505:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346674304 00000100:00100000:2.0:1787574255.431509:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346674304 00000100:00100000:2.0:1787574255.431544:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787574255.431550:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019a78dbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:7439:x1874407346674304:12345-0@lo:256: 20000000:01000000:2.0:1787574255.431566:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787574255.431581:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787574255.431584:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787574255.432000:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019a78dbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:7439:x1874407346674304:12345-0@lo:256: Request processed in 449us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574255.432008:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787574255.434701:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bdeef217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674304:0@lo:256: 10000000:01000000:0.0:1787574255.435346:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787574255.435372:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.435383:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574255.435400:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca526758000 from 1 10000000:01000000:0.0:1787574255.435403:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574255.435438:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.435446:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.435454:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.435474:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6af0108 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674432:0@lo:101: 00000100:00100000:0.0:1787574255.435532:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.435574:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ccac2ff0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574255.435603:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346674432 00000100:00100000:0.0:1787574255.435610:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346674432 00000100:00100000:0.0:1787574255.435660:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574255.435668:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2d520be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:7439:x1874407346674432:12345-0@lo:101: 00010000:00010000:0.0:1787574255.435681:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574255.435692:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b700e73a/0xd18a1efeeddb7b69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7b62 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.435714:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b700e73a/0xd18a1efeeddb7b69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b62 expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.435723:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b700e73a/0xd18a1efeeddb7b69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b62 expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.435730:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b700e73a, rc 0) 00000100:00100000:0.0:1787574255.435772:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2d520be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:7439:x1874407346674432:12345-0@lo:101: Request processed in 105us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.435779:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574255.435819:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6af0108 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674432:0@lo:101: 00010000:00010000:0.0:1787574255.435832:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.435840:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.435937:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6af0108 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674560:0@lo:501: 00000100:00100000:0.0:1787574255.435960:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.435975:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ccac2ff0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574255.436049:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346674560 00000100:00100000:1.0:1787574255.436054:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346674560 00000100:00100000:1.0:1787574255.436089:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787574255.436095:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059748312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:7439:x1874407346674560:12345-0@lo:501: 00000100:00100000:1.0:1787574255.436185:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059748312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:7439:x1874407346674560:12345-0@lo:501: Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.436192:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787574255.436222:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6af0108 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674560:0@lo:501: 00000100:00100000:1.0:1787574255.436274:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb880abc pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674688:0@lo:503: 00000100:00100000:1.0:1787574255.436311:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574255.436324:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 000000007555d777 going to sleep for 11 seconds 00000100:00100000:1.0:1787574255.436335:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346674688 00000100:00100000:1.0:1787574255.436338:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346674688 00000100:00100000:1.0:1787574255.436353:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787574255.436358:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005538823a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:7439:x1874407346674688:12345-0@lo:503: 00000040:00080000:1.0:1787574255.436388:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787574255.436423:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005538823a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:7439:x1874407346674688:12345-0@lo:503: Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.436430:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787574255.436464:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb880abc pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674688:0@lo:503: 00000040:00080000:1.0:1787574255.436727:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574255.436771:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1787574255.436835:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574255.438698:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1787574255.438856:0:7439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787574255.438885:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574255.438936:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.438948:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574255.439002:0:7439:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787574255.439005:0:7439:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca526758000 10000000:01000000:3.0:1787574255.439008:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca526758000 10000000:01000000:3.0:1787574255.439012:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787574255.439017:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca526758000 from 1 10000000:01000000:3.0:1787574255.439020:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787574255.439050:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000d1f34eb1/0xd18a1efeeddb7b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.439058:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000d1f34eb1/0xd18a1efeeddb7b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.439066:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000d1f34eb1/0xd18a1efeeddb7b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574255.439086:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674816:0@lo:101: 00000100:00100000:3.0:1787574255.439147:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574255.439203:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd610bd6 going to sleep for 11 seconds 00000100:00100000:3.0:1787574255.439441:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346674816 00000100:00100000:3.0:1787574255.439448:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346674816 00000100:00100000:3.0:1787574255.439486:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574255.439494:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec7bb8d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:7439:x1874407346674816:12345-0@lo:101: 00010000:00010000:3.0:1787574255.439507:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574255.439520:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee2e08ba/0xd18a1efeeddb7b77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7b70 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.439541:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee2e08ba/0xd18a1efeeddb7b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b70 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.439551:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee2e08ba/0xd18a1efeeddb7b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b70 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.439558:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee2e08ba, rc 0) 00000100:00100000:3.0:1787574255.439595:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec7bb8d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7439:x1874407346674816:12345-0@lo:101: Request processed in 101us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574255.439601:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574255.439642:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674816:0@lo:101: 00010000:00010000:3.0:1787574255.439655:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000d1f34eb1/0xd18a1efeeddb7b70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574255.439662:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000d1f34eb1/0xd18a1efeeddb7b70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574255.439746:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674944:0@lo:501: 00000100:00100000:3.0:1787574255.439771:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.439803:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346674944 00000100:00100000:0.0:1787574255.439808:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346674944 00000100:00100000:3.0:1787574255.439901:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd610bd6 going to sleep for 11 seconds 00000100:00100000:3.0:1787574255.439924:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574255.439931:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038223ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7439:x1874407346674944:12345-0@lo:501: 00000100:00100000:3.0:1787574255.440071:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038223ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7439:x1874407346674944:12345-0@lo:501: Request processed in 140us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574255.440078:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787574255.440149:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b948ba4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346674944:0@lo:501: 00000100:00100000:1.0:1787574255.440176:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb880abc pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346675072:0@lo:503: 00000100:00100000:1.0:1787574255.440214:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574255.440433:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 000000008bf36295 going to sleep for 11 seconds 00000100:00100000:3.0:1787574255.440516:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346675072 00000100:00100000:3.0:1787574255.440521:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346675072 00000100:00100000:0.0:1787574255.441055:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574255.441065:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df8f0911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7439:x1874407346675072:12345-0@lo:503: 00000100:00100000:0.0:1787574255.441171:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df8f0911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7439:x1874407346675072:12345-0@lo:503: Request processed in 107us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.441178:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574255.441298:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb880abc pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346675072:0@lo:503: 00000040:00080000:3.0:1787574255.441557:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574255.441633:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005af92374 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346675200:0@lo:502: 00000100:00100000:3.0:1787574255.441671:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574255.442123:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346675200 00000100:00100000:1.0:1787574255.442130:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346675200 00000100:00100000:1.0:1787574255.442159:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787574255.442165:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008192a2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7439:x1874407346675200:12345-0@lo:502: 00000100:00100000:1.0:1787574255.442416:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008192a2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7439:x1874407346675200:12345-0@lo:502: Request processed in 251us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.442424:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787574255.442525:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000530a7f1c going to sleep for 11 seconds 00000100:00100000:3.0:1787574255.442542:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005af92374 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346675200:0@lo:502: 00000040:00080000:3.0:1787574255.442729:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787574255.442755:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787574255.442768:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787574255.442781:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787574255.442794:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787574255.442809:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787574255.442822:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787574255.442836:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787574255.442849:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787574255.442860:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787574255.442874:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787574255.442889:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787574255.442902:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787574255.442915:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787574255.442928:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787574255.442941:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787574255.442966:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787574255.442980:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787574255.442995:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787574255.443007:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787574255.443018:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787574255.443030:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787574255.443043:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787574255.443057:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787574255.443071:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787574255.443084:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787574255.443098:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787574255.443110:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1787574255.443135:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005af92374 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346675328:0@lo:502: 00000100:00100000:3.0:1787574255.443177:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574255.443210:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000530a7f1c going to sleep for 11 seconds 00000100:00100000:1.0:1787574255.443565:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346675328 00000100:00100000:1.0:1787574255.443571:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346675328 00000100:00100000:1.0:1787574255.443597:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787574255.443604:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005178c670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7439:x1874407346675328:12345-0@lo:502: 00000100:00100000:1.0:1787574255.443693:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005178c670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7439:x1874407346675328:12345-0@lo:502: Request processed in 89us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.443700:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787574255.443746:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005af92374 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346675328:0@lo:502: 00000040:00080000:1.0:1787574255.443792:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787574255.443801:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787574255.444078:0:7458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787574255.444101:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000beb83495) 00000020:00000080:1.0:1787574255.444121:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787574255.444192:0:7458:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000045e756b1 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787574255.444196:0:7458:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000045e756b1 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787574255.444198:0:7458:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000045e756b1 3 00010000:00080000:1.0:1787574255.444224:0:7458:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005380f8c9@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1787574255.448535:0:7458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1787574255.448758:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787574255.448802:0:7458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787574255.448815:0:7458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd18a1efeeddb7b85 00000100:00080000:1.0:1787574255.448835:0:7458:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574255.448840:0:7458:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000005380f8c9 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574255.448872:0:7458:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003e6e7c82 x1874407346675456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787574255.448906:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e6e7c82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346675456:0@lo:38: 00000100:00100000:1.0:1787574255.448980:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574255.449059:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346675456 00000100:00100000:1.0:1787574255.449066:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346675456 00000100:00100000:1.0:1787574255.449096:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574255.449103:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f28e5c3b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346675456:12345-0@lo:38: 00010000:00080000:1.0:1787574255.449124:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1787574255.449158:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd18a1efeeddb7b8c 00000004:00100000:1.0:1787574255.449172:0:6509:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787574255.449200:0:6509:0:(import.c:65:import_set_state_nolock()) 000000003709dcf1 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574255.450746:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f28e5c3b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874407346675456:12345-0@lo:38: Request processed in 1637us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.450759:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787574255.450811:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003e6e7c82 x1874407346675456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574255.450823:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787574255.450832:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787574255.450839:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787574255.450843:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787574255.450845:0:3633:0:(import.c:65:import_set_state_nolock()) 000000005380f8c9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787574255.450852:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e6e7c82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346675456:0@lo:38: 00000100:00080000:1.0:1787574255.450873:0:7458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1787574255.451107:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787574255.451159:0:7439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787574255.451191:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787574255.451203:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000d1f34eb1/0xd18a1efeeddb7b70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574255.451211:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000d1f34eb1/0xd18a1efeeddb7b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787574255.451409:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787574255.451412:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787574255.451414:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574255.451415:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574255.451416:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574255.451418:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574255.451419:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787574255.451421:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787574255.451422:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787574255.451423:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574255.451425:0:7439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787574255.451428:0:7439:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787574255.451431:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787574255.451432:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787574255.451433:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574255.451434:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574255.451435:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574255.451437:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574255.451437:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787574255.451438:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787574255.451439:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787574255.451440:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574255.451441:0:7439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787574255.451460:0:7439:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787574255.451474:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e6e7c82 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346675584:0@lo:253: 00000100:00100000:1.0:1787574255.451525:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574255.451552:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 000000002720e2b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574255.451581:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346675584 00000100:00100000:1.0:1787574255.451587:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346675584 00000100:00100000:1.0:1787574255.451621:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787574255.451629:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086f85b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7439:x1874407346675584:12345-0@lo:253: 20000000:01000000:1.0:1787574255.451652:0:6503:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787574255.451665:0:6503:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:1.0:1787574255.451854:0:7459:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 20000000:01000000:1.0:1787574255.467594:0:6503:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787574255.467618:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787574255.467904:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086f85b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7439:x1874407346675584:12345-0@lo:253: Request processed in 16273us (16375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.467918:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787574255.468018:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e6e7c82 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7439:1874407346675584:0@lo:253: 10000000:01000000:1.0:1787574255.468031:0:7439:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787574255.468034:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787574255.468036:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787574255.468038:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574255.468039:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574255.468040:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574255.468041:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574255.468043:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787574255.468044:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787574255.468045:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787574255.468047:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574255.468048:0:7439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787574255.468061:0:7439:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787574255.470282:0:6525:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787574255.470291:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787574255.470321:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470338:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7ab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7aac expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470345:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005663ca29/0xd18a1efeeddb7b54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b4d expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470365:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470406:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005663ca29/0xd18a1efeeddb7b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7b4d expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470422:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005663ca29/0xd18a1efeeddb7b54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b4d expref: 14 pid: 6503 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.470437:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006756c65e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346675712:0@lo:104: 00000100:00100000:0.0:1787574255.470496:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574255.470551:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7aac expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470560:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7ab3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7aac expref: 14 pid: 6501 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.470568:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346675840:0@lo:104: 00000100:00100000:0.0:1787574255.470590:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.470605:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set 00000000736ff06d going to sleep for 11 seconds 00000100:00100000:0.0:1787574255.470630:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346675712 00000100:00100000:0.0:1787574255.470637:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346675712 00000100:00100000:0.0:1787574255.470670:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346675840 00000100:00100000:0.0:1787574255.470673:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346675840 00000100:00100000:0.0:1787574255.470685:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574255.470693:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000551a34f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6525:x1874407346675712:12345-0@lo:104: 00010000:00010000:0.0:1787574255.470705:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470762:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574255.470768:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000551a34f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6525:x1874407346675712:12345-0@lo:104: Request processed in 76us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.470775:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574255.470790:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574255.470795:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000629410af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6525:x1874407346675840:12345-0@lo:104: 00010000:00010000:0.0:1787574255.470801:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470828:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787574255.470832:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000629410af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6525:x1874407346675840:12345-0@lo:104: Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.470838:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574255.470869:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006756c65e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346675712:0@lo:104: 00000100:00100000:0.0:1787574255.470876:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346675840:0@lo:104: 00010000:00010000:0.0:1787574255.470894:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470910:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574255.470914:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470920:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000033b157ee already unused, calling callback (00000000218a87f8) 10000000:00010000:0.0:1787574255.470923:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470930:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574255.470943:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574255.470948:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574255.470974:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.470980:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574255.470996:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471002:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 0000000033b157ee/0xd18a1efeeddb7b4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b54 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471015:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574255.471017:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471023:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000051b061ba already unused, calling callback (00000000218a87f8) 10000000:00010000:0.0:1787574255.471025:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471030:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574255.471036:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574255.471041:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574255.471057:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471063:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574255.471067:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471072:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 0000000051b061ba/0xd18a1efeeddb7aac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471084:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574255.471085:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574255.471087:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574255.471092:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574255.471103:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346675968:0@lo:103: 00000100:00100000:0.0:1787574255.471127:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.471147:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574255.471152:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006756c65e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346676096:0@lo:103: 00000100:00100000:0.0:1787574255.471171:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.471200:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346675968 00000100:00100000:0.0:1787574255.471204:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346675968 00010000:00010000:0.0:1787574255.471218:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005663ca29/0xd18a1efeeddb7b54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b4d expref: 15 pid: 6503 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.471235:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346676096 00000100:00100000:0.0:1787574255.471277:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346676096 00010000:00010000:0.0:1787574255.471289:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7ab3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7aac expref: 16 pid: 6501 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.471306:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574255.471312:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081ff9f11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:3634:x1874407346675968:12345-0@lo:103: 00010000:00010000:0.0:1787574255.471327:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574255.471332:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005663ca29/0xd18a1efeeddb7b54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b4d expref: 16 pid: 6503 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471340:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005663ca29/0xd18a1efeeddb7b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b4d expref: 16 pid: 6503 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471353:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005663ca29/0xd18a1efeeddb7b54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7b4d expref: 16 pid: 6503 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471365:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574255.471390:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081ff9f11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:3634:x1874407346675968:12345-0@lo:103: Request processed in 79us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.471395:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574255.471407:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574255.471412:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eef0b5c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:3634:x1874407346676096:12345-0@lo:103: 00010000:00010000:0.0:1787574255.471419:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574255.471422:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7ab3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7aac expref: 14 pid: 6501 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471429:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7aac expref: 14 pid: 6501 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471438:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7ab3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7aac expref: 14 pid: 6501 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471450:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471456:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787574255.471473:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024863812s 00010000:00010000:0.0:1787574255.471476:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471481:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471486:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471491:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471496:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dbd22c9a already unused, calling callback (00000000b88c46cf) 00010000:00010000:0.0:1787574255.471499:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471505:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471516:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471523:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574255.471545:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eef0b5c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:3634:x1874407346676096:12345-0@lo:103: Request processed in 133us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.471551:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787574255.471593:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471611:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574255.471616:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dbd22c9a/0xd18a1efeeddb7b93 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574255.471640:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006756c65e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346676096:0@lo:103: 00000100:00100000:0.0:1787574255.471647:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346675968:0@lo:103: 00000100:00080000:2.0:1787574255.473580:0:6514:0:(import.c:65:import_set_state_nolock()) 000000007fe905c4 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574255.473669:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0b023e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1874407346673920:12345-0@lo:38: Request processed in 43005us (46170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574255.473680:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574255.473897:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787574255.473906:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787574255.473914:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787574255.473918:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787574255.473921:0:3633:0:(import.c:65:import_set_state_nolock()) 0000000069702c9c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787574255.473942:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff711fb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346673920:0@lo:38: 00080000:10000000:1.0:1787574255.475008:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00000100:00100000:2.0:1787574255.475540:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574255.475555:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0c5892f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346676224:0@lo:41: 00000100:00100000:2.0:1787574255.475611:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.475723:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346676224 00000100:00100000:0.0:1787574255.475730:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346676224 00000100:00100000:0.0:1787574255.475776:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574255.475785:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000821346c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346676224:12345-0@lo:41: 00000004:00000024:0.0:1787574255.475814:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787574255.475909:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000821346c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346676224:12345-0@lo:41: Request processed in 126us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.475916:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574255.475956:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0c5892f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346676224:0@lo:41: 00080000:10000000:1.0:1787574255.476650:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787574255.476957:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787574255.477138:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787574255.478059:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787574255.478649:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787574255.479544:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787574255.479788:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787574255.479981:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1787574255.480148:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787574255.480625:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1787574255.480844:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1787574255.482798:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1787574255.483069:0:7464:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1787574255.483117:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ae0f3b4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7464:1874407346676352:0@lo:700: 00000100:00100000:2.0:1787574255.483196:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574255.483233:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e47ce54 going to sleep for 11 seconds 00000100:00100000:0.0:1787574255.483466:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346676352 00000100:00100000:0.0:1787574255.483475:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346676352 00000100:00100000:0.0:1787574255.483526:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574255.483534:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097cfa0cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7464:x1874407346676352:12345-0@lo:700: 00000040:01000000:3.0:1787574255.484293:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787574255.485493:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076ca6e63 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1874407346676480:0@lo:1000: 00000100:00100000:3.0:1787574255.485561:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574255.485584:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set 00000000acf4a841 going to sleep for 11 seconds 00000040:01000000:2.0:1787574255.486016:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787574255.486131:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787574255.486605:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346676480 00000100:00100000:0.0:1787574255.486615:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346676480 00000100:00100000:0.0:1787574255.486666:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574255.486675:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000476f480f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7465:x1874407346676480:12345-0@lo:1000: 00000100:00100000:0.0:1787574255.486784:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000476f480f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7465:x1874407346676480:12345-0@lo:1000: Request processed in 109us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.486791:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574255.486840:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076ca6e63 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1874407346676480:0@lo:1000: 00000040:01000000:0.0:1787574255.486872:0:7465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787574255.486901:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1874407346676608:0@lo:700: 00000100:00100000:0.0:1787574255.486933:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.486962:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346676608 00000100:00100000:0.0:1787574255.486966:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346676608 00000100:00100000:0.0:1787574255.486991:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574255.486997:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006756c65e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+6:7465:x1874407346676608:12345-0@lo:700: 00000100:00100000:0.0:1787574255.487032:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006756c65e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+6:7465:x1874407346676608:12345-0@lo:700: Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.487038:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574255.487056:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set 000000008abcc7c1 going to sleep for 11 seconds 00000100:00100000:0.0:1787574255.487067:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1874407346676608:0@lo:700: 00000100:00100000:0.0:1787574255.487102:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7465:1874407346676736:0@lo:900: 00000100:00100000:0.0:1787574255.487129:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574255.487154:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set 000000008abcc7c1 going to sleep for 11 seconds 00000004:00000080:2.0:1787574255.487871:0:7439:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787574255.487884:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787574255.488117:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00100000:0.0:1787574255.488673:0:6488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1787574255.489133:0:7463:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787574255.489138:0:7463:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787574255.489188:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346676736 00000100:00100000:1.0:1787574255.489197:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346676736 00000100:00100000:1.0:1787574255.489271:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574255.489290:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006dbd9ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7465:x1874407346676736:12345-0@lo:900: 00000100:00100000:1.0:1787574255.489385:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006dbd9ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7465:x1874407346676736:12345-0@lo:900: Request processed in 98us (2256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.489395:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1787574255.490338:0:7439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787574255.490859:0:7439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787574255.490890:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787574255.491099:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787574255.491498:0:7439:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787574255.492151:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787574255.492325:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787574255.492447:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787574255.492567:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787574255.492740:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787574255.492872:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787574255.493084:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787574255.493217:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00010000:00080000:1.0:1787574255.493557:0:7465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000663200ca x1874407346676736/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787574271 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574255.493575:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7465:1874407346676736:0@lo:900: 00000100:00100000:1.0:1787574255.493689:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff711fb2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1874407346676864:0@lo:1000: 00000100:00100000:1.0:1787574255.493752:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574255.493800:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set 000000007e75d023 going to sleep for 11 seconds 00000100:00100000:0.0:1787574255.493968:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346676864 00000100:00100000:0.0:1787574255.493975:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346676864 00000100:00100000:0.0:1787574255.494029:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574255.494038:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e6e7c82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1874407346676864:12345-0@lo:1000: 00000100:00100000:0.0:1787574255.494108:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e6e7c82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1874407346676864:12345-0@lo:1000: Request processed in 72us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574255.494126:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787574255.494263:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff711fb2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1874407346676864:0@lo:1000: 00000004:00080000:1.0:1787574255.494316:0:7465:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000669b496d with version 0 00000020:00100000:1.0:1787574255.494339:0:7465:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787574255.494344:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ff711fb2 x1874407346677120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787574255.494357:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff711fb2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1874407346677120:0@lo:1000: 00000100:00100000:1.0:1787574255.494381:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574255.494394:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0e46adc going to sleep for 11 seconds 00000100:00100000:0.0:1787574255.494579:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346677120 00000100:00100000:0.0:1787574255.494584:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346677120 00000100:00100000:0.0:1787574255.494612:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574255.494619:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092154abf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1874407346677120:12345-0@lo:1000: 40000000:02000000:3.0:1787574255.494787:0:6516:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1787574255.497690:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787574255.497880:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787574255.498015:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787574255.498154:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787574255.499121:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787574255.499592:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787574255.499739:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787574255.499890:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787574255.500194:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787574255.502791:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787574255.502956:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787574255.503158:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787574255.505816:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787574255.506027:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000100:00100000:1.0:1787574255.507105:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097cfa0cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7464:x1874407346676352:12345-0@lo:700: Request processed in 23566us (23904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.507123:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787574255.507190:0:7464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007ae0f3b4 x1874407346676352/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787574271 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574255.507205:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ae0f3b4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7464:1874407346676352:0@lo:700: 40000000:02000000:1.0:1787574255.507218:0:7464:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1787574255.512597:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787574255.512933:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787574255.513075:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787574255.513222:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787574255.514745:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787574255.514942:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787574255.515076:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787574255.515226:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787574255.517472:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787574255.520717:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787574255.520957:0:7439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787574255.523760:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1787574255.524008:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092154abf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1874407346677120:12345-0@lo:1000: Request processed in 29386us (29622us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787574255.524026:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1787574255.524097:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787574255.524102:0:7465:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787574255.524116:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff711fb2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1874407346677120:0@lo:1000: 00000100:00100000:2.0:1787574255.524463:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ff52d4f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1874407346677248:0@lo:1000: 00000100:00100000:2.0:1787574255.524504:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574255.524574:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b804eda going to sleep for 11 seconds 00000100:00100000:1.0:1787574255.524619:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346677248 00000100:00100000:1.0:1787574255.524626:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346677248 00000100:00100000:1.0:1787574255.524704:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574255.524713:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000610b33f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1874407346677248:12345-0@lo:1000: 00000100:00100000:1.0:1787574255.524844:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000610b33f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1874407346677248:12345-0@lo:1000: Request processed in 132us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574255.524851:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574255.524921:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ff52d4f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1874407346677248:0@lo:1000: 00000040:00080000:3.0:1787574255.524940:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1787574255.524974:0:7465:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000530a7f1c with version 1 00000004:00080000:2.0:1787574255.526712:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f4bf51dc version 1 rpc_version 1 00000020:00100000:2.0:1787574255.526756:0:7455:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787574255.526767:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d4ae390d x1874407346677504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574255.526790:0:7455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4ae390d pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1874407346677504:0@lo:1000: 00000100:00100000:2.0:1787574255.526849:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574255.526923:0:7455:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f5965b87 going to sleep for 11 seconds 00000040:00080000:3.0:1787574255.527910:0:7465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787574255.527992:0:7465:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1787574255.528532:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346677504 00000100:00100000:1.0:1787574255.528542:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346677504 00000100:00100000:1.0:1787574255.528642:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574255.528654:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003e3b1ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7455:x1874407346677504:12345-0@lo:1000: 00000001:00080000:2.0:1787574255.530564:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1787574255.530735:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003e3b1ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7455:x1874407346677504:12345-0@lo:1000: Request processed in 2080us (3883us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787574255.530747:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1787574255.530826:0:7455:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787574255.530831:0:7455:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787574255.530865:0:7455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4ae390d pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1874407346677504:0@lo:1000: 00000040:00080000:1.0:1787574255.534694:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787574255.534775:0:7439:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787574255.534813:0:7439:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa7bcc1bd7988 00100000:10000000:2.0:1787574255.534820:0:7439:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787574255.535434:0:7439:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787574255.535464:0:7439:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787574255.535488:0:7439:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787574255.535514:0:7439:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787574255.538658:0:7439:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574255.538876:0:7439:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1787574255.578839:0:7464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787574255.578929:0:7464:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787574255.578935:0:7464:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1787574256.308495:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574257.329512:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574258.356606:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574259.377397:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574260.401632:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574260.465689:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4ae390d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346677632:0@lo:400: 00000100:00100000:0.0:1787574260.465784:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574260.465847:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574260.465852:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014e44b76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346678016:0@lo:400: 00000100:00100000:0.0:1787574260.465877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574260.465907:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a7a395cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346677760:0@lo:400: 00000100:00100000:0.0:1787574260.465932:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574260.465950:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574260.465982:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081c2a7dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346677888:0@lo:400: 00000100:00100000:0.0:1787574260.466010:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574260.466069:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346678016 00000100:00100000:0.0:1787574260.466078:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346678016 00000100:00100000:0.0:1787574260.466119:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346677760 00000100:00100000:0.0:1787574260.466123:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346677760 00000100:00100000:0.0:1787574260.466141:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574260.466151:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efde72c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346678016:12345-0@lo:400: 00000100:00100000:0.0:1787574260.466220:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efde72c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346678016:12345-0@lo:400: Request processed in 71us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574260.466229:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574260.466300:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574260.466308:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e83da071 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346677760:12345-0@lo:400: 00000100:00100000:0.0:1787574260.466337:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e83da071 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346677760:12345-0@lo:400: Request processed in 32us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574260.466343:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574260.466362:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346677888 00000100:00100000:0.0:1787574260.466365:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346677888 00000100:00100000:0.0:1787574260.466387:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574260.466392:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081ff9f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346677888:12345-0@lo:400: 00000100:00100000:0.0:1787574260.466426:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081ff9f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346677888:12345-0@lo:400: Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574260.466433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574260.466600:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081c2a7dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346677888:0@lo:400: 00010000:00080000:0.0:1787574260.466616:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a7a395cf x1874407346677760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574260.466626:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a7a395cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346677760:0@lo:400: 00010000:00080000:0.0:1787574260.466665:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000014e44b76 x1874407346678016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574260.466674:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014e44b76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346678016:0@lo:400: 00000100:00100000:2.0:1787574260.467093:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346677632 00000100:00100000:2.0:1787574260.467099:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346677632 00000100:00100000:2.0:1787574260.467149:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574260.467156:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048be10ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:3637:x1874407346677632:12345-0@lo:400: 00000100:00100000:2.0:1787574260.467212:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048be10ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:3637:x1874407346677632:12345-0@lo:400: Request processed in 57us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574260.467218:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787574260.470318:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4ae390d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346677632:0@lo:400: 00000001:02000400:1.0:1787574260.647998:0:7710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787574260.978413:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092475f36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346678144:0@lo:41: 00000100:00100000:3.0:1787574260.978493:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574260.978655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346678144 00000100:00100000:2.0:1787574260.978664:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346678144 00000100:00100000:2.0:1787574260.978717:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787574260.978725:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d8a407a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346678144:12345-0@lo:41: 00000004:00000024:2.0:1787574260.978755:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787574260.978887:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d8a407a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346678144:12345-0@lo:41: Request processed in 162us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574260.978894:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574260.981518:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092475f36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346678144:0@lo:41: 00010000:00010000:0.0:1787574261.426367:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787574261.491578:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574261.491587:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca526758000 from 4 10000000:01000000:1.0:1787574261.491593:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574261.491633:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000007079dcfa/0xd18a1efeeddb7b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.491646:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000007079dcfa/0xd18a1efeeddb7b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.491656:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000007079dcfa/0xd18a1efeeddb7b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574261.491680:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346678272:0@lo:101: 00000100:00100000:1.0:1787574261.491745:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.491786:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 0000000060daec26 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.491814:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346678272 00000100:00100000:1.0:1787574261.491847:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346678272 00000100:00100000:1.0:1787574261.491894:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787574261.491902:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e04e9b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:6506:x1874407346678272:12345-0@lo:101: 00010000:00010000:1.0:1787574261.491915:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574261.491926:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001930c3ba/0xd18a1efeeddb7ba1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7b9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.491947:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001930c3ba/0xd18a1efeeddb7ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b9a expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.491956:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001930c3ba/0xd18a1efeeddb7ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b9a expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.491965:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001930c3ba, rc 0) 00000100:00100000:1.0:1787574261.492002:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e04e9b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:6506:x1874407346678272:12345-0@lo:101: Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.492009:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787574261.492054:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346678272:0@lo:101: 00010000:00010000:1.0:1787574261.492066:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000007079dcfa/0xd18a1efeeddb7b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.492075:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000007079dcfa/0xd18a1efeeddb7b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574261.492123:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346678400:0@lo:256: 00000100:00100000:1.0:1787574261.492150:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.492162:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 0000000060daec26 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.492173:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346678400 00000100:00100000:1.0:1787574261.492176:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346678400 00000100:00100000:1.0:1787574261.492416:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787574261.492422:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6a6010d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:6506:x1874407346678400:12345-0@lo:256: 20000000:01000000:1.0:1787574261.492436:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787574261.492451:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787574261.492454:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787574261.492521:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6a6010d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:6506:x1874407346678400:12345-0@lo:256: Request processed in 100us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.492528:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787574261.492553:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346678400:0@lo:256: 10000000:01000000:1.0:1787574261.492585:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787574261.492590:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000007079dcfa/0xd18a1efeeddb7b9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.492598:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000007079dcfa/0xd18a1efeeddb7b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574261.492607:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787574261.492608:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca5109bd800 from 21 10000000:01000000:1.0:1787574261.492610:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787574261.492623:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000005663ca29/0xd18a1efeeddb7ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.492630:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000005663ca29/0xd18a1efeeddb7ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.492636:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000005663ca29/0xd18a1efeeddb7ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574261.492647:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346678528:0@lo:101: 00000100:00100000:1.0:1787574261.492675:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.492687:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 0000000060daec26 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.492698:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346678528 00000100:00100000:1.0:1787574261.492701:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346678528 00000100:00100000:1.0:1787574261.492720:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787574261.492725:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060b78c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:6506:x1874407346678528:12345-0@lo:101: 00010000:00010000:1.0:1787574261.492732:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574261.492740:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7baf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.492754:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7ba8 expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.492761:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d6a2127/0xd18a1efeeddb7baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7ba8 expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.492767:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d6a2127, rc 0) 00000100:00100000:1.0:1787574261.492792:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060b78c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346678528:12345-0@lo:101: Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.492798:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787574261.492825:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346678528:0@lo:101: 00010000:00010000:1.0:1787574261.492834:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000005663ca29/0xd18a1efeeddb7ba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.492841:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000005663ca29/0xd18a1efeeddb7ba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574261.492896:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346678656:0@lo:501: 00000100:00100000:1.0:1787574261.492923:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.492934:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d1d6e0c going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.492944:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346678656 00000100:00100000:1.0:1787574261.492947:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346678656 00000100:00100000:1.0:1787574261.492964:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787574261.492968:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019208cc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346678656:12345-0@lo:501: 00000100:00100000:1.0:1787574261.493069:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019208cc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346678656:12345-0@lo:501: Request processed in 100us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.493076:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787574261.493102:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346678656:0@lo:501: 00000100:00100000:1.0:1787574261.493125:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346678784:0@lo:503: 00000100:00100000:1.0:1787574261.493161:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.493173:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d1d6e0c going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.493184:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346678784 00000100:00100000:1.0:1787574261.493200:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346678784 00000100:00100000:1.0:1787574261.493221:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787574261.493226:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d3ece23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346678784:12345-0@lo:503: 00000100:00100000:1.0:1787574261.493314:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d3ece23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346678784:12345-0@lo:503: Request processed in 87us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.493320:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787574261.493353:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346678784:0@lo:503: 00000100:00100000:1.0:1787574261.493565:0:7741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7741:1874407346678912:0@lo:502: 00000100:00100000:1.0:1787574261.493596:0:7741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.493613:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346678912 00000100:00100000:1.0:1787574261.493617:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346678912 00000100:00100000:1.0:1787574261.493638:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787574261.493650:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad0a4da2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7741:x1874407346678912:12345-0@lo:502: 00000100:00100000:1.0:1787574261.493717:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad0a4da2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7741:x1874407346678912:12345-0@lo:502: Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.493724:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787574261.493751:0:7741:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f3dbf30 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.493763:0:7741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7741:1874407346678912:0@lo:502: 00000100:00100000:1.0:1787574261.493799:0:7741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7741:1874407346679040:0@lo:502: 00000100:00100000:1.0:1787574261.493829:0:7741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.493845:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346679040 00000100:00100000:1.0:1787574261.493848:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346679040 00000100:00100000:1.0:1787574261.493865:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787574261.493870:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007861f84d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7741:x1874407346679040:12345-0@lo:502: 00000100:00100000:1.0:1787574261.493917:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007861f84d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:7741:x1874407346679040:12345-0@lo:502: Request processed in 47us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.493924:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787574261.493946:0:7741:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f3dbf30 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.493955:0:7741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7741:1874407346679040:0@lo:502: 00000040:00080000:1.0:1787574261.493970:0:7741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787574261.494015:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787574261.494029:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787574261.494034:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000005663ca29/0xd18a1efeeddb7ba8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494042:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000005663ca29/0xd18a1efeeddb7ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574261.494050:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574261.494057:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca5109bd800 from 4 10000000:01000000:1.0:1787574261.494060:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574261.494077:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000c2bcde17/0xd18a1efeeddb7bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494084:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000c2bcde17/0xd18a1efeeddb7bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494092:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000c2bcde17/0xd18a1efeeddb7bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574261.494103:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346679168:0@lo:101: 00000100:00100000:1.0:1787574261.494126:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.494137:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f3dbf30 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.494148:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346679168 00000100:00100000:1.0:1787574261.494151:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346679168 00000100:00100000:1.0:1787574261.494168:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787574261.494173:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7440117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346679168:12345-0@lo:101: 00010000:00010000:1.0:1787574261.494179:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574261.494204:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc84aab5/0xd18a1efeeddb7bbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7bb6 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494221:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc84aab5/0xd18a1efeeddb7bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7bb6 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494229:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc84aab5/0xd18a1efeeddb7bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7bb6 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494235:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc84aab5, rc 0) 00000100:00100000:1.0:1787574261.494283:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7440117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346679168:12345-0@lo:101: Request processed in 111us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.494295:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787574261.494324:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346679168:0@lo:101: 00010000:00010000:1.0:1787574261.494333:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000c2bcde17/0xd18a1efeeddb7bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494340:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000c2bcde17/0xd18a1efeeddb7bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574261.494380:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346679296:0@lo:256: 00000100:00100000:1.0:1787574261.494407:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.494420:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f3dbf30 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.494431:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346679296 00000100:00100000:1.0:1787574261.494434:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346679296 00000100:00100000:1.0:1787574261.494452:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787574261.494457:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011570419 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346679296:12345-0@lo:256: 20000000:01000000:1.0:1787574261.494468:0:6501:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787574261.494481:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787574261.494484:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787574261.494540:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011570419 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346679296:12345-0@lo:256: Request processed in 82us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.494546:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787574261.494570:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346679296:0@lo:256: 10000000:01000000:1.0:1787574261.494600:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787574261.494604:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000c2bcde17/0xd18a1efeeddb7bb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494610:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000c2bcde17/0xd18a1efeeddb7bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574261.494621:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787574261.494623:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787574261.494625:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787574261.494636:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000c63a25d9/0xd18a1efeeddb7bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494642:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000c63a25d9/0xd18a1efeeddb7bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494648:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000c63a25d9/0xd18a1efeeddb7bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574261.494657:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346679424:0@lo:101: 00000100:00100000:1.0:1787574261.494677:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.494687:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f3dbf30 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.494697:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346679424 00000100:00100000:1.0:1787574261.494699:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346679424 00000100:00100000:1.0:1787574261.494716:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787574261.494721:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048fc3667 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346679424:12345-0@lo:101: 00010000:00010000:1.0:1787574261.494727:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574261.494735:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016414bdd/0xd18a1efeeddb7bcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7bc4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494747:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016414bdd/0xd18a1efeeddb7bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7bc4 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494755:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016414bdd/0xd18a1efeeddb7bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7bc4 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494772:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016414bdd, rc 0) 00000100:00100000:1.0:1787574261.494798:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048fc3667 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346679424:12345-0@lo:101: Request processed in 77us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.494803:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787574261.494828:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346679424:0@lo:101: 00010000:00010000:1.0:1787574261.494836:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000c63a25d9/0xd18a1efeeddb7bc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.494843:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000c63a25d9/0xd18a1efeeddb7bc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574261.494878:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346679552:0@lo:501: 00000100:00100000:1.0:1787574261.494897:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.494907:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f3dbf30 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.494917:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346679552 00000100:00100000:1.0:1787574261.494921:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346679552 00000100:00100000:1.0:1787574261.494938:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787574261.494943:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011459745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346679552:12345-0@lo:501: 00000100:00100000:1.0:1787574261.495026:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011459745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346679552:12345-0@lo:501: Request processed in 83us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.495032:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787574261.495057:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346679552:0@lo:501: 00000100:00100000:1.0:1787574261.495078:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346679680:0@lo:503: 00000100:00100000:1.0:1787574261.495111:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.495123:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f3dbf30 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.495140:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346679680 00000100:00100000:1.0:1787574261.495143:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346679680 00000100:00100000:1.0:1787574261.495161:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787574261.495166:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2e8b915 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346679680:12345-0@lo:503: 00000100:00100000:1.0:1787574261.499095:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2e8b915 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346679680:12345-0@lo:503: Request processed in 3920us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.499120:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787574261.499346:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a41c60cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346679680:0@lo:503: 00000100:00100000:1.0:1787574261.506078:0:7743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076ec99f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7743:1874407346679808:0@lo:502: 00000100:00100000:1.0:1787574261.506171:0:7743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.506222:0:7743:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e47ce54 going to sleep for 11 seconds 00000100:00100000:3.0:1787574261.506473:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346679808 00000100:00100000:3.0:1787574261.506481:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346679808 00000100:00100000:3.0:1787574261.506525:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787574261.506533:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ffd61ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:7743:x1874407346679808:12345-0@lo:502: 00000100:00100000:3.0:1787574261.506721:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ffd61ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:7743:x1874407346679808:12345-0@lo:502: Request processed in 188us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574261.506729:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787574261.513988:0:7743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076ec99f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7743:1874407346679808:0@lo:502: 00000020:01000000:1.0:1787574261.514051:0:7743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574261.514066:0:7743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574261.514068:0:7743:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787574261.514076:0:7743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787574261.514080:0:7743:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:1.0:1787574261.514120:0:7743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574261.514137:0:7743:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000059d3874c) 00000020:00000080:1.0:1787574261.514160:0:7743:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1787574261.514166:0:7743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787574261.514303:0:7743:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787574261.514309:0:7743:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787574261.514316:0:7743:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb7bd9 00010000:00080000:1.0:1787574261.514350:0:7743:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c81158cb@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1787574261.515972:0:7743:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1787574261.532646:0:7743:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787574261.532661:0:7743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787574261.532702:0:7743:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787574261.532723:0:7743:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb7be0 00000100:00080000:3.0:1787574261.532733:0:7743:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574261.532739:0:7743:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000c81158cb using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574261.532777:0:7743:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006853b05a x1874407346679936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574261.532803:0:7743:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787574261.532952:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3a00602 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346680064:0@lo:400: 00000100:00100000:3.0:1787574261.533016:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574261.533051:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574261.533057:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f5f29b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346680192:0@lo:400: 00000100:00100000:3.0:1787574261.533083:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574261.533128:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346680064 00000100:00100000:3.0:1787574261.533134:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346680064 00000100:00100000:3.0:1787574261.533170:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346680192 00000100:00100000:3.0:1787574261.533173:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346680192 00000100:00100000:3.0:1787574261.533216:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574261.533224:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fef63c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346680064:12345-0@lo:400: 00000100:00100000:3.0:1787574261.533294:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fef63c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346680064:12345-0@lo:400: Request processed in 71us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574261.533302:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574261.533315:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574261.533320:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076ca6e63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346680192:12345-0@lo:400: 00000100:00100000:3.0:1787574261.533341:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076ca6e63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346680192:12345-0@lo:400: Request processed in 22us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574261.533347:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787574261.533453:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008f5f29b1 x1874407346680192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574261.533466:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f5f29b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346680192:0@lo:400: 00010000:00080000:3.0:1787574261.533475:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f3a00602 x1874407346680064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574261.533483:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3a00602 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346680064:0@lo:400: 00000040:01000000:3.0:1787574261.533521:0:7743:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1787574261.533772:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006853b05a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346679936:0@lo:38: 00000100:00100000:1.0:1787574261.533809:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574261.533961:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346679936 00000100:00100000:0.0:1787574261.533967:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346679936 00000100:00100000:0.0:1787574261.533995:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574261.533999:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076ec99f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346679936:12345-0@lo:38: 00010000:00080000:0.0:1787574261.534019:0:6515:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1787574261.534049:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb7be7 00000004:00100000:0.0:1787574261.534062:0:6515:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787574261.534068:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787574261.539513:0:7747:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000ffe052dc x1874407346680320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574261.539533:0:7747:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073fe7768 going to sleep for 0 seconds 00000020:01000000:3.0:1787574261.539625:0:7743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574261.539631:0:7743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574261.539633:0:7743:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787574261.539636:0:7743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574261.539639:0:7743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574261.539641:0:7743:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787574261.539643:0:7743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787574261.539649:0:7743:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787574261.539671:0:7743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3a00602 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7743:1874407346680448:0@lo:502: 00000100:00100000:3.0:1787574261.539740:0:7743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574261.539780:0:7743:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd610bd6 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.539823:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346680448 00000100:00100000:1.0:1787574261.539840:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346680448 00000100:00100000:1.0:1787574261.539886:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787574261.539895:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a610547 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:7743:x1874407346680448:12345-0@lo:502: 00000100:00100000:1.0:1787574261.540016:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a610547 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:7743:x1874407346680448:12345-0@lo:502: Request processed in 122us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574261.540025:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574261.540168:0:7743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3a00602 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:7743:1874407346680448:0@lo:502: 00000020:01000000:3.0:1787574261.540202:0:7743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574261.540206:0:7743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574261.540207:0:7743:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787574261.540210:0:7743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787574261.540787:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787574261.540808:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787574261.540815:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000c63a25d9/0xd18a1efeeddb7bc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.540826:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000c63a25d9/0xd18a1efeeddb7bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574261.540846:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787574261.540848:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ca5050d4d28 from 1 10000000:01000000:1.0:1787574261.540850:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787574261.540873:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000002c509034/0xd18a1efeeddb7bee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.540880:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000002c509034/0xd18a1efeeddb7bee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574261.540888:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000002c509034/0xd18a1efeeddb7bee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574261.540902:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ebeaada pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346680576:0@lo:101: 00000100:00100000:1.0:1787574261.540939:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.540968:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 0000000033c0dab1 going to sleep for 11 seconds 00000100:00100000:3.0:1787574261.541064:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346680576 00000100:00100000:3.0:1787574261.541070:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346680576 00000100:00100000:3.0:1787574261.541106:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574261.541113:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cd05920 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346680576:12345-0@lo:101: 00010000:00010000:3.0:1787574261.541122:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574261.541133:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a6ec9a95/0xd18a1efeeddb7bf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7bee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574261.541153:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a6ec9a95/0xd18a1efeeddb7bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7bee expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574261.541161:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a6ec9a95/0xd18a1efeeddb7bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7bee expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574261.541169:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a6ec9a95, rc 0) 00000100:00100000:3.0:1787574261.541224:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cd05920 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346680576:12345-0@lo:101: Request processed in 111us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574261.541230:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787574261.541328:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ebeaada pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346680576:0@lo:101: 00010000:00010000:0.0:1787574261.541340:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000002c509034/0xd18a1efeeddb7bee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574261.541348:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000002c509034/0xd18a1efeeddb7bee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574261.541398:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346680704:0@lo:501: 00000100:00100000:0.0:1787574261.541424:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574261.541441:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004a95fd7 going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.541955:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346680704 00000100:00100000:1.0:1787574261.541961:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346680704 00000100:00100000:1.0:1787574261.541992:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787574261.541998:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e36ba434 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346680704:12345-0@lo:501: 00000100:00100000:1.0:1787574261.542141:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e36ba434 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346680704:12345-0@lo:501: Request processed in 144us (717us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787574261.542149:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787574261.548992:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346680704:0@lo:501: 10000000:01000000:0.0:1787574261.549042:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787574261.549066:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000002c509034/0xd18a1efeeddb7bee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574261.549077:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000002c509034/0xd18a1efeeddb7bee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787574261.561115:0:6515:0:(import.c:65:import_set_state_nolock()) 00000000a92f6342 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574261.561279:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076ec99f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1874407346679936:12345-0@lo:38: Request processed in 27276us (27468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574261.561291:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787574261.561477:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787574261.561487:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787574261.561495:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787574261.561500:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787574261.561502:0:3633:0:(import.c:65:import_set_state_nolock()) 00000000c81158cb lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787574261.561520:0:3633:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000073fe7768): req@00000000ffe052dc x1874407346680320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574261.561539:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006853b05a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346679936:0@lo:38: 00000100:00100000:2.0:1787574261.561738:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574261.561751:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346680832:0@lo:41: 00000100:00100000:2.0:1787574261.561793:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574261.561933:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346680832 00000100:00100000:0.0:1787574261.561941:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346680832 00000100:00100000:0.0:1787574261.561983:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574261.561991:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ffc9992 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346680832:12345-0@lo:41: 00000004:00000024:0.0:1787574261.562015:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787574261.562076:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ffc9992 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346680832:12345-0@lo:41: Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574261.562083:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574261.562181:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000663200ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346680832:0@lo:41: 00000100:00100000:3.0:1787574261.564276:0:7747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574261.564312:0:7747:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073fe7768 going to sleep for 11 seconds 00000100:00100000:0.0:1787574261.566573:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346680320 00000100:00100000:0.0:1787574261.566587:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346680320 00000100:00100000:0.0:1787574261.566656:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574261.566664:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3a00602 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7747:x1874407346680320:12345-0@lo:1000: 00000100:00100000:0.0:1787574261.566784:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3a00602 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7747:x1874407346680320:12345-0@lo:1000: Request processed in 121us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574261.566792:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574261.566841:0:7747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffe052dc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7747:1874407346680320:0@lo:1000: 00000040:01000000:3.0:1787574261.566878:0:7747:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787574261.566920:0:7747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f5f29b1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7747:1874407346680960:0@lo:1000: 00000100:00100000:3.0:1787574261.566956:0:7747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574261.566984:0:7747:0:(client.c:2715:ptlrpc_set_wait()) set 000000002aee17b5 going to sleep for 11 seconds 00000100:00100000:0.0:1787574261.567652:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346680960 00000100:00100000:0.0:1787574261.567660:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346680960 00000100:00100000:0.0:1787574261.567699:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787574261.567716:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cefc7143 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7747:x1874407346680960:12345-0@lo:1000: 00000100:00100000:0.0:1787574261.567887:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cefc7143 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7747:x1874407346680960:12345-0@lo:1000: Request processed in 183us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574261.567894:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574261.568010:0:7747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f5f29b1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7747:1874407346680960:0@lo:1000: 00000100:00100000:3.0:1787574261.568078:0:7747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f5f29b1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7747:1874407346681088:0@lo:700: 00000100:00100000:3.0:1787574261.568107:0:7747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574261.568129:0:7747:0:(client.c:2715:ptlrpc_set_wait()) set 00000000530a7f1c going to sleep for 11 seconds 00000100:00100000:0.0:1787574261.569868:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346681088 00000100:00100000:0.0:1787574261.569884:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346681088 00000100:00100000:0.0:1787574261.569948:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574261.569956:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005af92374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7747:x1874407346681088:12345-0@lo:700: 00000100:00100000:0.0:1787574261.570042:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005af92374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7747:x1874407346681088:12345-0@lo:700: Request processed in 88us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574261.570049:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574261.573578:0:7747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f5f29b1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7747:1874407346681088:0@lo:700: 00000100:00100000:3.0:1787574261.573823:0:7747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f5f29b1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7747:1874407346681216:0@lo:1000: 00000100:00100000:3.0:1787574261.573885:0:7747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574261.573922:0:7747:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cb28759 going to sleep for 11 seconds 00000100:00100000:2.0:1787574261.573945:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346681216 00000100:00100000:2.0:1787574261.573960:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346681216 00000100:00100000:2.0:1787574261.574017:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574261.574026:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b948ba4a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7747:x1874407346681216:12345-0@lo:1000: 00000100:00100000:2.0:1787574261.574272:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b948ba4a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7747:x1874407346681216:12345-0@lo:1000: Request processed in 247us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574261.574280:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787574261.575289:0:7747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f5f29b1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7747:1874407346681216:0@lo:1000: 00000004:00080000:3.0:1787574261.575351:0:7747:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000530a7f1c with version 0 00000020:00100000:3.0:1787574261.575370:0:7747:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787574261.575376:0:7747:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000008f5f29b1 x1874407346681472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574261.575393:0:7747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f5f29b1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7747:1874407346681472:0@lo:1000: 00000100:00100000:3.0:1787574261.575430:0:7747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574261.575456:0:7747:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d1d6e0c going to sleep for 11 seconds 00000100:00100000:1.0:1787574261.575543:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346681472 00000100:00100000:1.0:1787574261.575549:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346681472 00000100:00100000:1.0:1787574261.575590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787574261.575598:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c80c8809 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7747:x1874407346681472:12345-0@lo:1000: 00000001:00080000:1.0:1787574261.577667:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1787574261.577680:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787574261.578079:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c80c8809 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7747:x1874407346681472:12345-0@lo:1000: Request processed in 2479us (2645us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787574261.578094:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787574261.578270:0:7747:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787574261.578275:0:7747:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787574261.578288:0:7747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f5f29b1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7747:1874407346681472:0@lo:1000: 00000100:00100000:1.0:1787574261.578375:0:7747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000365a847b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7747:1874407346681600:0@lo:1000: 00000100:00100000:1.0:1787574261.578413:0:7747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574261.578447:0:7747:0:(client.c:2715:ptlrpc_set_wait()) set 00000000139eef08 going to sleep for 11 seconds 00000100:00100000:2.0:1787574261.578518:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346681600 00000100:00100000:2.0:1787574261.578526:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346681600 00000100:00100000:2.0:1787574261.578563:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574261.578570:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006252e26d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7747:x1874407346681600:12345-0@lo:1000: 00000100:00100000:2.0:1787574261.578637:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006252e26d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7747:x1874407346681600:12345-0@lo:1000: Request processed in 68us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574261.578644:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787574261.578704:0:7747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000365a847b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7747:1874407346681600:0@lo:1000: 00000040:00080000:1.0:1787574261.578719:0:7747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787574261.578753:0:7747:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000afb2d25d with version 1 00000004:00080000:2.0:1787574261.579197:0:7744:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000e13f4dac version 1 rpc_version 1 00000020:00100000:2.0:1787574261.579217:0:7744:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787574261.579224:0:7744:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000092475f36 x1874407346681856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574261.579257:0:7744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092475f36 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7744:1874407346681856:0@lo:1000: 00000100:00100000:2.0:1787574261.579289:0:7744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574261.579307:0:7744:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d000df2 going to sleep for 11 seconds 00000100:00100000:2.0:1787574261.579319:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346681856 00000100:00100000:2.0:1787574261.579322:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346681856 00000100:00100000:2.0:1787574261.579340:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574261.579345:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ae390d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7744:x1874407346681856:12345-0@lo:1000: 00000040:00080000:1.0:1787574261.584592:0:7747:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787574261.584682:0:7747:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787574261.584688:0:7747:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1787574261.612332:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1787574261.612882:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ae390d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7744:x1874407346681856:12345-0@lo:1000: Request processed in 33531us (33588us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787574261.612897:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1787574261.613231:0:7744:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787574261.613236:0:7744:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787574261.613295:0:7744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092475f36 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7744:1874407346681856:0@lo:1000: 00000020:00000004:1.0:1787574261.761505:0:7767:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574261.761788:0:7767:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574262.459357:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574263.473419:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574264.500701:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787574264.949883:0:7868:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787574264.950119:0:7868:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574265.521499:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787574266.001871:0:7917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5e2c1000 20000000:00000080:3.0:1787574266.001893:0:7917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ca53b217000 uarg=0000000000000000 20000000:01000000:3.0:1787574266.001934:0:7917:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787574266.001941:0:7917:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787574266.001947:0:7917:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787574266.002018:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787574266.002030:0:7917:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787574266.006505:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574266.006765:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787574266.006802:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787574266.006819:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787574266.006834:0:7917:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787574266.006853:0:7917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574266.006873:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000925f75cc/0xd18a1efeeddb7a7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7a74 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574266.006880:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b700e73a/0xd18a1efeeddb7b69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b62 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574266.006887:0:7917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574266.006928:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b700e73a/0xd18a1efeeddb7b69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7b62 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574266.006943:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b700e73a/0xd18a1efeeddb7b69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b62 expref: 17 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574266.006956:0:7917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0affae3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1874407346681984:0@lo:104: 00000100:00100000:3.0:1787574266.007031:0:7917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787574266.007195:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000925f75cc/0xd18a1efeeddb7a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7a74 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574266.007202:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000925f75cc/0xd18a1efeeddb7a7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a74 expref: 17 pid: 6504 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574266.007210:0:7917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9d80956 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1874407346682112:0@lo:104: 00000100:00100000:3.0:1787574266.007229:0:7917:0:(client.c:2715:ptlrpc_set_wait()) set 00000000530a7f1c going to sleep for 11 seconds 00000100:00100000:0.0:1787574266.011269:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787574266.011316:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574266.011353:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346681984 00000100:00100000:0.0:1787574266.011362:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346681984 00000100:00100000:0.0:1787574266.011398:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346682112 00000100:00100000:0.0:1787574266.011400:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346682112 00000100:00100000:0.0:1787574266.011412:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574266.011419:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c0ac5ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:7917:x1874407346681984:12345-0@lo:104: 00010000:00010000:0.0:1787574266.011454:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011529:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574266.011534:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c0ac5ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:7917:x1874407346681984:12345-0@lo:104: Request processed in 116us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574266.011541:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574266.011579:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574266.011584:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6af0108 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:7917:x1874407346682112:12345-0@lo:104: 00010000:00010000:0.0:1787574266.011590:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011616:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787574266.011619:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6af0108 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:7917:x1874407346682112:12345-0@lo:104: Request processed in 36us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574266.011625:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787574266.011639:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574266.011643:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011650:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009e9912e3 already unused, calling callback (00000000218a87f8) 10000000:00010000:0.0:1787574266.011653:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011661:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574266.011667:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574266.011678:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574266.011708:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011714:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574266.011727:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011733:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 000000009e9912e3/0xd18a1efeeddb7b62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b69 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011745:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574266.011746:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011751:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d1be3903 already unused, calling callback (00000000218a87f8) 10000000:00010000:0.0:1787574266.011753:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011759:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574266.011764:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574266.011768:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574266.011775:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011780:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574266.011796:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011801:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 00000000d1be3903/0xd18a1efeeddb7a74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7a7b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.011816:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574266.011818:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574266.011820:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574266.011825:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574266.011847:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072514252 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346682240:0@lo:103: 00000100:00100000:0.0:1787574266.011883:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574266.011925:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008946474b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346682368:0@lo:103: 00000100:00100000:0.0:1787574266.011945:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574266.011975:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346682240 00000100:00100000:0.0:1787574266.011979:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346682240 00010000:00010000:0.0:1787574266.011996:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b700e73a/0xd18a1efeeddb7b69 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b62 expref: 18 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574266.012016:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346682368 00000100:00100000:0.0:1787574266.012019:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346682368 00010000:00010000:0.0:1787574266.012030:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000925f75cc/0xd18a1efeeddb7a7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a74 expref: 19 pid: 6504 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574266.012044:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574266.012049:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006941e92e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:3637:x1874407346682240:12345-0@lo:103: 00010000:00010000:0.0:1787574266.012075:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574266.012080:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b700e73a/0xd18a1efeeddb7b69 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b62 expref: 19 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012100:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b700e73a/0xd18a1efeeddb7b69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b62 expref: 19 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012116:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574266.012140:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006941e92e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:3637:x1874407346682240:12345-0@lo:103: Request processed in 92us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574266.012158:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574266.012172:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574266.012177:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000551a34f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:3634:x1874407346682368:12345-0@lo:103: 00010000:00010000:0.0:1787574266.012184:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574266.012187:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000925f75cc/0xd18a1efeeddb7a7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a74 expref: 18 pid: 6504 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012196:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000925f75cc/0xd18a1efeeddb7a7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7a74 expref: 18 pid: 6504 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012208:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012215:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012228:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012234:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012260:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012273:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012277:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bdcaed32 already unused, calling callback (00000000b88c46cf) 00010000:00010000:0.0:1787574266.012280:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012286:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012293:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574266.012300:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574266.012324:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000551a34f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:3634:x1874407346682368:12345-0@lo:103: Request processed in 148us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574266.012329:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574266.012365:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008946474b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346682368:0@lo:103: 00000100:00100000:0.0:1787574266.012383:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072514252 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346682240:0@lo:103: 00010000:00010000:3.0:1787574266.012929:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b700e73a/0xd18a1efeeddb7b69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7b62 expref: 17 pid: 6501 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574266.012942:0:7917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0affae3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1874407346681984:0@lo:104: 00010000:00010000:3.0:1787574266.012949:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000925f75cc/0xd18a1efeeddb7a7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7a74 expref: 16 pid: 6504 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574266.012955:0:7917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9d80956 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1874407346682112:0@lo:104: 00010000:00010000:3.0:1787574266.012970:0:7917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574266.012977:0:7917:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574266.012981:0:7917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574266.012985:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bdcaed32/0xd18a1efeeddb7bfc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574266.097615:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574266.097653:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014e44b76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346682496:0@lo:41: 00000100:00100000:3.0:1787574266.097722:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574266.097881:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346682496 00000100:00100000:2.0:1787574266.097889:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346682496 00000100:00100000:2.0:1787574266.097942:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574266.097951:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9d80956 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346682496:12345-0@lo:41: 00000004:00000024:2.0:1787574266.097996:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787574266.098042:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9d80956 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346682496:12345-0@lo:41: Request processed in 92us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574266.098049:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787574266.099101:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014e44b76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346682496:0@lo:41: 00010000:00010000:2.0:1787574266.555481:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574266.614547:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec9f651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346682752:0@lo:400: 00000100:00100000:3.0:1787574266.614621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574266.614674:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574266.614680:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0affae3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346682624:0@lo:400: 00000100:00100000:3.0:1787574266.614703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574266.614725:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023c402d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346682880:0@lo:400: 00000100:00100000:3.0:1787574266.614749:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574266.614797:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346682752 00000100:00100000:3.0:1787574266.614805:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346682752 00000100:00100000:3.0:1787574266.614845:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346682624 00000100:00100000:3.0:1787574266.614849:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346682624 00000100:00100000:3.0:1787574266.614863:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574266.614870:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001012be42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346682752:12345-0@lo:400: 00000100:00100000:3.0:1787574266.614922:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001012be42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346682752:12345-0@lo:400: Request processed in 52us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574266.614929:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574266.614942:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574266.614947:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f5f29b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346682624:12345-0@lo:400: 00000100:00100000:3.0:1787574266.614969:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f5f29b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346682624:12345-0@lo:400: Request processed in 23us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574266.614975:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787574266.615010:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d0affae3 x1874407346682624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574266.615023:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0affae3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346682624:0@lo:400: 00010000:00080000:3.0:1787574266.615049:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002ec9f651 x1874407346682752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574266.615070:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec9f651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346682752:0@lo:400: 00000100:00100000:2.0:1787574266.615307:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346682880 00000100:00100000:2.0:1787574266.615312:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346682880 00000100:00100000:2.0:1787574266.615342:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574266.615347:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006853b05a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346682880:12345-0@lo:400: 00000100:00100000:2.0:1787574266.615393:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006853b05a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346682880:12345-0@lo:400: Request processed in 46us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574266.615399:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574266.615434:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023c402d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346682880:0@lo:400: 00000100:00100000:2.0:1787574266.615698:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec9f651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346683008:0@lo:41: 00000100:00100000:2.0:1787574266.615728:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574266.615874:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346683008 00000100:00100000:3.0:1787574266.615879:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346683008 00000100:00100000:3.0:1787574266.615908:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574266.615914:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7a395cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346683008:12345-0@lo:41: 00000004:00000024:3.0:1787574266.615939:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787574266.615985:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7a395cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346683008:12345-0@lo:41: Request processed in 71us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574266.615991:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787574266.616080:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec9f651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346683008:0@lo:41: 00010000:00010000:0.0:1787574267.570206:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574268.594663:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574269.617456:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787574270.196224:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787574270.196232:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca526758000 from 1 10000000:01000000:2.0:1787574270.196236:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574270.196287:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000ed45b8c2/0xd18a1efeeddb7c03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574270.196299:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000ed45b8c2/0xd18a1efeeddb7c03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574270.196310:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000ed45b8c2/0xd18a1efeeddb7c03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574270.196333:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081c2a7dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346683136:0@lo:101: 00000100:00100000:2.0:1787574270.196409:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574270.196457:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a5cb484 going to sleep for 11 seconds 00000100:00100000:1.0:1787574270.196790:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346683136 00000100:00100000:1.0:1787574270.196799:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346683136 00000100:00100000:1.0:1787574270.196843:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787574270.196853:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9c8f248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346683136:12345-0@lo:101: 00010000:00010000:1.0:1787574270.196866:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574270.196881:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000093b3a374/0xd18a1efeeddb7c0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7c03 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574270.196902:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000093b3a374/0xd18a1efeeddb7c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c03 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574270.196911:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000093b3a374/0xd18a1efeeddb7c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c03 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574270.196919:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000093b3a374, rc 0) 00000100:00100000:1.0:1787574270.196956:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9c8f248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346683136:12345-0@lo:101: Request processed in 105us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574270.196969:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787574270.197073:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081c2a7dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346683136:0@lo:101: 00010000:00010000:2.0:1787574270.197087:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000ed45b8c2/0xd18a1efeeddb7c03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574270.197095:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000ed45b8c2/0xd18a1efeeddb7c03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574270.197183:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081c2a7dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346683264:0@lo:501: 00000100:00100000:2.0:1787574270.197214:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574270.197321:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a5cb484 going to sleep for 11 seconds 00000100:00100000:1.0:1787574270.199440:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346683264 00000100:00100000:1.0:1787574270.199454:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346683264 00000100:00100000:1.0:1787574270.199510:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787574270.199519:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ab98403 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346683264:12345-0@lo:501: 00000100:00100000:1.0:1787574270.199679:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ab98403 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346683264:12345-0@lo:501: Request processed in 160us (2463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574270.199687:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787574270.199781:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081c2a7dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346683264:0@lo:501: 00000100:00100000:0.0:1787574270.199827:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072514252 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346683392:0@lo:503: 00000100:00100000:0.0:1787574270.199871:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574270.199906:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f5fc8d6 going to sleep for 11 seconds 00000100:00100000:2.0:1787574270.199947:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346683392 00000100:00100000:2.0:1787574270.199951:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346683392 00000100:00100000:2.0:1787574270.199985:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787574270.199991:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f60e417f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346683392:12345-0@lo:503: 00000100:00100000:2.0:1787574270.200082:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f60e417f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346683392:12345-0@lo:503: Request processed in 91us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574270.200089:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787574270.200140:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072514252 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346683392:0@lo:503: 00000100:00100000:2.0:1787574270.200373:0:8121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ff52d4f pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8121:1874407346683520:0@lo:502: 00000100:00100000:2.0:1787574270.200406:0:8121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574270.200426:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346683520 00000100:00100000:2.0:1787574270.200429:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346683520 00000100:00100000:2.0:1787574270.200446:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787574270.200451:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb519861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:8121:x1874407346683520:12345-0@lo:502: 00000100:00100000:2.0:1787574270.200536:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb519861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:8121:x1874407346683520:12345-0@lo:502: Request processed in 85us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574270.200543:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787574270.200570:0:8121:0:(client.c:2715:ptlrpc_set_wait()) set 00000000948a408a going to sleep for 11 seconds 00000100:00100000:2.0:1787574270.200581:0:8121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ff52d4f pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8121:1874407346683520:0@lo:502: 00000020:01000000:2.0:1787574270.200600:0:8121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574270.200609:0:8121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574270.200611:0:8121:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787574270.200617:0:8121:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca526758000 00000020:00000080:2.0:1787574270.200619:0:8121:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787574270.200656:0:8121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8121:1874407346683648:0@lo:502: 00000100:00100000:2.0:1787574270.200687:0:8121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574270.200707:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346683648 00000100:00100000:2.0:1787574270.200710:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346683648 00000100:00100000:2.0:1787574270.200728:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787574270.200734:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:8121:x1874407346683648:12345-0@lo:502: 00000100:00100000:2.0:1787574270.200787:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:8121:x1874407346683648:12345-0@lo:502: Request processed in 53us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574270.200794:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787574270.200818:0:8121:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574270.200829:0:8121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8121:1874407346683648:0@lo:502: 00000020:01000000:2.0:1787574270.200847:0:8121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574270.200851:0:8121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574270.200853:0:8121:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787574270.200856:0:8121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787574270.200899:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787574270.200918:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787574270.200933:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb7c03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574270.200942:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb7c03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574270.200951:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787574270.200954:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca5109bd800 from 1 10000000:01000000:2.0:1787574270.200956:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574270.200979:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574270.200987:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574270.200996:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574270.201008:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346683776:0@lo:101: 00000100:00100000:2.0:1787574270.201032:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574270.201044:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574270.201054:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346683776 00000100:00100000:2.0:1787574270.201057:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346683776 00000100:00100000:2.0:1787574270.201072:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787574270.201077:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346683776:12345-0@lo:101: 00010000:00010000:2.0:1787574270.201085:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574270.201095:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb7c18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7c11 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574270.201126:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb7c18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c11 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574270.201144:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb7c18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c11 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574270.201152:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb400, rc 0) 00000100:00100000:2.0:1787574270.201181:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346683776:12345-0@lo:101: Request processed in 102us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574270.201187:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787574270.201212:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346683776:0@lo:101: 00010000:00010000:2.0:1787574270.201223:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574270.201232:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574270.201287:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346683904:0@lo:501: 00000100:00100000:2.0:1787574270.201310:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574270.201322:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574270.201333:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346683904 00000100:00100000:2.0:1787574270.201336:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346683904 00000100:00100000:2.0:1787574270.201352:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787574270.201358:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346683904:12345-0@lo:501: 00000100:00100000:2.0:1787574270.201438:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346683904:12345-0@lo:501: Request processed in 79us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574270.201444:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787574270.201469:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346683904:0@lo:501: 00000100:00100000:2.0:1787574270.201491:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346684032:0@lo:503: 00000100:00100000:2.0:1787574270.201527:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574270.201540:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574270.201550:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346684032 00000100:00100000:2.0:1787574270.201554:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346684032 00000100:00100000:2.0:1787574270.201570:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787574270.201576:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346684032:12345-0@lo:503: 00000100:00100000:2.0:1787574270.201638:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346684032:12345-0@lo:503: Request processed in 62us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574270.201644:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787574270.201680:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346684032:0@lo:503: 00000100:00100000:1.0:1787574270.202526:0:8122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8122:1874407346684160:0@lo:502: 00000100:00100000:1.0:1787574270.202577:0:8122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574270.202611:0:8122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53522fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574270.204232:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346684160 00000100:00100000:2.0:1787574270.204268:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346684160 00000100:00100000:2.0:1787574270.204328:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787574270.204339:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:8122:x1874407346684160:12345-0@lo:502: 00000100:00100000:2.0:1787574270.204480:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:8122:x1874407346684160:12345-0@lo:502: Request processed in 142us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574270.204487:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787574270.204595:0:8122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8122:1874407346684160:0@lo:502: 00000020:01000000:1.0:1787574270.204628:0:8122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574270.204637:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574270.204639:0:8122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787574270.204645:0:8122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca5109bd800 00000020:00000080:1.0:1787574270.204647:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787574270.204678:0:8122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8122:1874407346684288:0@lo:502: 00000100:00100000:1.0:1787574270.204719:0:8122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574270.204753:0:8122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53522fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574270.204792:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346684288 00000100:00100000:2.0:1787574270.204796:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346684288 00000100:00100000:2.0:1787574270.204826:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787574270.204833:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:8122:x1874407346684288:12345-0@lo:502: 00000100:00100000:2.0:1787574270.204891:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:8122:x1874407346684288:12345-0@lo:502: Request processed in 58us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574270.204898:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787574270.204960:0:8122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8122:1874407346684288:0@lo:502: 00000020:01000000:1.0:1787574270.204977:0:8122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574270.204981:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574270.204982:0:8122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787574270.204985:0:8122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787574270.205214:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787574270.205233:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787574270.205268:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574270.205285:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574270.641577:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574271.218075:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574271.218110:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5050ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346684416:0@lo:41: 00000100:00100000:3.0:1787574271.218180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574271.218216:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346684416 00000100:00100000:1.0:1787574271.218229:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346684416 00000100:00100000:1.0:1787574271.218293:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574271.218302:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346684416:12345-0@lo:41: 00000004:00000024:1.0:1787574271.218332:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787574271.218381:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346684416:12345-0@lo:41: Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574271.218387:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574271.218437:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5050ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346684416:0@lo:41: 00010000:00010000:0.0:1787574271.666468:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574271.729612:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346684544:0@lo:41: 00000100:00100000:1.0:1787574271.729686:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574271.729824:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346684544 00000100:00100000:2.0:1787574271.729832:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346684544 00000100:00100000:2.0:1787574271.730569:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787574271.730580:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346684544:12345-0@lo:41: 00000004:00000024:2.0:1787574271.730614:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787574271.730947:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346684544:12345-0@lo:41: Request processed in 368us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574271.730955:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787574271.731276:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346684800:0@lo:400: 00000100:00100000:2.0:1787574271.731312:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574271.731338:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574271.731344:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346684672:0@lo:400: 00000100:00100000:2.0:1787574271.731371:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574271.731405:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346684800 00000100:00100000:2.0:1787574271.731411:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346684800 00000100:00100000:2.0:1787574271.731441:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574271.731448:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346684800:12345-0@lo:400: 00000100:00100000:2.0:1787574271.731485:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346684800:12345-0@lo:400: Request processed in 38us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574271.731492:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787574271.731527:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca5045a9c00 x1874407346684800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574271.731541:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346684800:0@lo:400: 00000100:00100000:1.0:1787574271.736989:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346684544:0@lo:41: 00000100:00100000:1.0:1787574271.737023:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574271.737034:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346684928:0@lo:400: 00000100:00100000:1.0:1787574271.737106:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574271.737183:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346684672 00000100:00100000:1.0:1787574271.737190:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346684672 00000100:00100000:1.0:1787574271.737257:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574271.737267:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:3635:x1874407346684672:12345-0@lo:400: 00000100:00100000:1.0:1787574271.737318:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:3635:x1874407346684672:12345-0@lo:400: Request processed in 52us (5945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574271.737326:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574271.737358:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346684928 00000100:00100000:1.0:1787574271.737362:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346684928 00000100:00100000:1.0:1787574271.737389:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574271.737396:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346684928:12345-0@lo:400: 00000100:00100000:1.0:1787574271.737430:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346684928:12345-0@lo:400: Request processed in 35us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574271.737449:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574271.737486:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346684672:0@lo:400: 00010000:00080000:1.0:1787574271.737514:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca5045a8700 x1874407346684928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574271.737524:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346684928:0@lo:400: 00010000:00010000:1.0:1787574272.697204:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574273.714651:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574274.739493:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574275.761364:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574276.338168:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5050fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346685056:0@lo:41: 00000100:00100000:1.0:1787574276.338303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.338404:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346685056 00000100:00100000:0.0:1787574276.338421:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346685056 00000100:00100000:0.0:1787574276.338496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787574276.338509:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346685056:12345-0@lo:41: 00000004:00000024:0.0:1787574276.338548:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1787574276.338647:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346685056:12345-0@lo:41: Request processed in 141us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.338659:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787574276.339373:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5050fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346685056:0@lo:41: 00000020:01000004:3.0:1787574276.342848:0:8417:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787574276.342853:0:8417:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787574276.342854:0:8417:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787574276.343074:0:8417:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ca53bc3a000 00000020:01000004:3.0:1787574276.343091:0:8417:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787574276.343105:0:8417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787574276.343128:0:8417:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ca53b148000) 00000020:00000080:3.0:1787574276.343146:0:8417:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787574276.409949:0:8417:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787574276.410095:0:8417:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787574276.486951:0:8417:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787574276.487188:0:8417:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787574276.487199:0:8417:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787574276.487210:0:8417:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd18a1efeeddb7c26 00000020:01000004:2.0:1787574276.487217:0:8417:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787574276.487261:0:8417:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787574276.487266:0:8417:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787574276.487271:0:8417:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787574276.487277:0:8417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787574276.487288:0:8417:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ca535084d28) 00000020:00000080:2.0:1787574276.487299:0:8417:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787574276.495930:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574276.496144:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787574276.496151:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787574276.505096:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787574276.505110:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787574276.505874:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787574276.505883:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787574276.515905:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574276.516135:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787574276.516142:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787574276.551312:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787574276.551333:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787574276.606955:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787574276.607204:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787574276.607211:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787574276.617384:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787574276.617399:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787574276.619880:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787574276.619896:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787574276.625875:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574276.626113:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787574276.626120:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787574276.627158:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787574276.627167:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787574276.709013:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574276.709223:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787574276.709229:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787574276.711828:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787574276.711842:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787574276.712557:0:8417:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787574276.712589:0:8417:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787574276.712595:0:8417:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787574276.745106:0:8417:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787574276.745146:0:8417:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787574276.745150:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787574276.745152:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787574276.745153:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574276.745154:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574276.745155:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574276.745156:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574276.745158:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574276.745159:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574276.745160:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574276.745166:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574276.745167:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574276.745171:0:8417:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787574276.745173:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574276.745174:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787574276.745175:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574276.745176:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574276.745176:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574276.745177:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574276.745178:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574276.745179:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574276.745180:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574276.745180:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574276.745181:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574276.745210:0:8417:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787574276.745233:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346685184:0@lo:253: 00000100:00100000:2.0:1787574276.745369:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574276.745652:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574276.745908:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346685184 00000100:00100000:1.0:1787574276.745916:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346685184 00000100:00100000:1.0:1787574276.746092:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787574276.746103:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:8417:x1874407346685184:12345-0@lo:253: 20000000:01000000:1.0:1787574276.746150:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787574276.746155:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787574276.746161:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787574276.746164:0:6504:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787574276.746428:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574276.746577:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787574276.746765:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787574276.746788:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787574276.746797:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787574276.746810:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787574276.747409:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787574276.747515:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787574276.747532:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:1.0:1787574276.747554:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:1.0:1787574276.747573:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787574276.747580:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787574276.747703:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787574276.747712:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:1.0:1787574276.747727:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787574276.747734:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787574276.747745:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787574276.747759:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787574276.747904:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1787574276.748540:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:1.0:1787574276.748543:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:1.0:1787574276.748569:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1787574276.748578:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787574276.748592:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1787574276.748597:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:1.0:1787574276.748633:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1787574276.748641:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787574276.748653:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1787574276.748668:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1787574276.749362:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1787574276.749381:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:1.0:1787574276.749382:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:1.0:1787574276.749397:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1787574276.749402:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787574276.749412:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1787574276.749418:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:1.0:1787574276.749503:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1787574276.749512:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787574276.749526:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1787574276.749553:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1787574276.749566:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787574276.749568:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787574276.749572:0:6504:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787574276.749621:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787574276.749623:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787574276.750168:0:8436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1787574276.750189:0:8436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1787574276.750202:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787574276.750420:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787574276.750510:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787574276.750523:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787574276.750532:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787574276.750534:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787574276.751398:0:8437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1787574276.751431:0:8437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1787574276.751449:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787574276.751566:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1787574276.751583:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1787574276.751595:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1787574276.751605:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787574276.751607:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787574276.759223:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1787574276.759314:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1787574276.759334:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1787574276.766499:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1787574276.766564:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1787574276.766712:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1787574276.766738:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787574276.766740:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787574276.774389:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787574276.782326:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787574276.782363:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787574276.782381:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1787574276.782404:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787574276.782424:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.782445:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca54216da00/0xd18a1efeeddb7b00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7af9 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.782454:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca54216d000/0xd18a1efeeddb7b77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b70 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.782479:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca509e19600/0xd18a1efeeddb7baf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7ba8 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.782486:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca509e19400/0xd18a1efeeddb7bcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7bc4 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.782494:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca54216c000/0xd18a1efeeddb7bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7bee expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.782501:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.782554:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca54216c000/0xd18a1efeeddb7bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7bee expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.782570:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca54216c000/0xd18a1efeeddb7bf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bee expref: 18 pid: 6503 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.782585:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1874407346685312:0@lo:104: 00000100:00100000:0.0:1787574276.782651:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574276.782845:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca509e19400/0xd18a1efeeddb7bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7bc4 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.782855:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca509e19400/0xd18a1efeeddb7bcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bc4 expref: 18 pid: 6503 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.782864:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1874407346685440:0@lo:104: 00000100:00100000:0.0:1787574276.782888:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574276.787957:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574276.788034:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca509e19600/0xd18a1efeeddb7baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7ba8 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.788060:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca509e19600/0xd18a1efeeddb7baf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7ba8 expref: 18 pid: 6501 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.788075:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1874407346685568:0@lo:104: 00000100:00100000:0.0:1787574276.788132:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574276.789543:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346685312 00000100:00100000:1.0:1787574276.789556:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346685312 00000100:00100000:1.0:1787574276.789618:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346685440 00000100:00100000:1.0:1787574276.789622:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346685440 00000100:00100000:1.0:1787574276.789640:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574276.789650:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6504:x1874407346685312:12345-0@lo:104: 00010000:00010000:1.0:1787574276.789667:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb7bee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.789772:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787574276.789779:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6504:x1874407346685312:12345-0@lo:104: Request processed in 130us (7128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.789800:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574276.790117:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787574276.790125:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6504:x1874407346685440:12345-0@lo:104: 00010000:00010000:1.0:1787574276.790134:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca509e19200/0xd18a1efeeddb7bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.790171:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787574276.790176:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6504:x1874407346685440:12345-0@lo:104: Request processed in 53us (7288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.790181:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787574276.790407:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574276.790414:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb7bee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.790422:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574276.790426:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb7bee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.790436:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb7bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574276.790444:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb7bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574276.790450:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574276.790490:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb7bee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.790496:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574276.790521:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb7bee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.790527:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb7bee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.790541:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574276.790543:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca509e19200/0xd18a1efeeddb7bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.790549:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574276.790551:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19200/0xd18a1efeeddb7bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.790557:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca509e19200/0xd18a1efeeddb7bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574276.790562:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19200/0xd18a1efeeddb7bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574276.790567:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574276.790580:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca509e19200/0xd18a1efeeddb7bc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.790585:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574276.790589:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19200/0xd18a1efeeddb7bc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.790594:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca509e19200/0xd18a1efeeddb7bc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7bcb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.790602:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574276.790609:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574276.790611:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574276.790627:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346685824:0@lo:103: 00000100:00100000:1.0:1787574276.790664:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574276.790708:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574276.790715:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346685696:0@lo:103: 00000100:00100000:1.0:1787574276.790735:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574276.793323:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574276.793368:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346685824 00000100:00100000:2.0:1787574276.793495:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346685824 00010000:00010000:2.0:1787574276.793535:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca509e19400/0xd18a1efeeddb7bcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bc4 expref: 19 pid: 6503 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574276.793577:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346685696 00000100:00100000:2.0:1787574276.793655:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346685696 00000100:00100000:1.0:1787574276.793763:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574276.793778:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:3635:x1874407346685824:12345-0@lo:103: 00010000:00010000:1.0:1787574276.793795:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574276.793802:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca509e19400/0xd18a1efeeddb7bcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bc4 expref: 20 pid: 6503 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.793829:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca509e19400/0xd18a1efeeddb7bcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bc4 expref: 20 pid: 6503 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.793849:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574276.793920:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca54216c000/0xd18a1efeeddb7bf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bee expref: 20 pid: 6503 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574276.793936:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:3635:x1874407346685824:12345-0@lo:103: Request processed in 162us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.793945:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787574276.793951:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574276.793961:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:3635:x1874407346685696:12345-0@lo:103: 00000100:00100000:3.0:1787574276.794087:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346685824:0@lo:103: 00010000:00010000:2.0:1787574276.794149:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574276.794154:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca54216c000/0xd18a1efeeddb7bf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bee expref: 19 pid: 6503 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.794163:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca54216c000/0xd18a1efeeddb7bf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bee expref: 19 pid: 6503 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.794173:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574276.794271:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:3635:x1874407346685696:12345-0@lo:103: Request processed in 313us (3534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.794277:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787574276.797944:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca54216d000/0xd18a1efeeddb7b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7b70 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.797964:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca54216d000/0xd18a1efeeddb7b77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b70 expref: 18 pid: 6504 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.797980:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1874407346685952:0@lo:104: 00000100:00100000:0.0:1787574276.798034:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574276.798076:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca54216da00/0xd18a1efeeddb7b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7af9 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.798085:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca54216da00/0xd18a1efeeddb7b00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7af9 expref: 18 pid: 6501 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.798093:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1874407346686080:0@lo:104: 00000100:00100000:0.0:1787574276.798139:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.798153:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782cb40 going to sleep for 11 seconds 00010000:00010000:0.0:1787574276.798177:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca54216c000/0xd18a1efeeddb7bf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7bee expref: 18 pid: 6503 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574276.798190:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346685568 00000100:00100000:0.0:1787574276.798194:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1874407346685312:0@lo:104: 00000100:00100000:2.0:1787574276.798200:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346685568 00010000:00010000:0.0:1787574276.798208:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca509e19400/0xd18a1efeeddb7bcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7bc4 expref: 17 pid: 6503 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.798227:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1874407346685440:0@lo:104: 00000100:00100000:2.0:1787574276.798267:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346685952 00000100:00100000:2.0:1787574276.798272:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346685952 00000100:00100000:2.0:1787574276.798288:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346686080 00000100:00100000:2.0:1787574276.798291:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346686080 00000100:00100000:2.0:1787574276.798311:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574276.798321:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:6504:x1874407346685568:12345-0@lo:104: 00010000:00010000:2.0:1787574276.798335:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb7ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798403:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787574276.798411:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:6504:x1874407346685568:12345-0@lo:104: Request processed in 91us (10278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.798418:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574276.798436:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574276.798442:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6504:x1874407346685952:12345-0@lo:104: 00010000:00010000:2.0:1787574276.798450:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca54216c800/0xd18a1efeeddb7b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.798489:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1874407346685568:0@lo:104: 00010000:00010000:2.0:1787574276.798501:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787574276.798503:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1874407346685952:0@lo:104: 00000100:00100000:2.0:1787574276.798510:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6504:x1874407346685952:12345-0@lo:104: Request processed in 66us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.798517:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574276.798532:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574276.798539:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6504:x1874407346686080:12345-0@lo:104: 00010000:00010000:2.0:1787574276.798546:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798595:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787574276.798601:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6504:x1874407346686080:12345-0@lo:104: Request processed in 63us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.798607:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787574276.798626:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787574276.798631:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb7ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798640:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574276.798644:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb7ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.798651:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1874407346686080:0@lo:104: 00010000:00010000:2.0:1787574276.798654:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb7ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574276.798664:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb7ba8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574276.798670:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574276.798692:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798729:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb7ba8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798736:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574276.798761:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb7ba8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798767:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb7ba8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7baf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798777:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574276.798781:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca54216c800/0xd18a1efeeddb7b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798786:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca54216c800 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574276.798789:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca54216c800/0xd18a1efeeddb7b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798796:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca54216c800/0xd18a1efeeddb7b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574276.798803:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca54216c800/0xd18a1efeeddb7b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574276.798808:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787574276.798825:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca54216c800/0xd18a1efeeddb7b70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798831:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574276.798837:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca54216c800/0xd18a1efeeddb7b70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798854:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca54216c800/0xd18a1efeeddb7b70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b77 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798864:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574276.798868:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798873:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574276.798876:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798883:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574276.798890:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574276.798896:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787574276.798899:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346686208:0@lo:103: 00010000:00010000:2.0:1787574276.798925:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7af9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.798933:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574276.798948:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7af9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.798951:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574276.798961:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7af9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7b00 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.798987:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574276.798993:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346686336:0@lo:103: 00000100:00100000:0.0:1787574276.799014:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.799040:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346686208 00000100:00100000:0.0:1787574276.799045:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346686208 00010000:00010000:0.0:1787574276.799075:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca509e19600/0xd18a1efeeddb7baf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7ba8 expref: 17 pid: 6501 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.799096:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346686336 00000100:00100000:0.0:1787574276.799099:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346686336 00010000:00010000:0.0:1787574276.799110:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca54216d000/0xd18a1efeeddb7b77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b70 expref: 18 pid: 6504 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.799126:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574276.799133:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:3636:x1874407346686208:12345-0@lo:103: 00010000:00010000:0.0:1787574276.799143:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574276.799149:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca509e19600/0xd18a1efeeddb7baf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7ba8 expref: 18 pid: 6501 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.799165:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca509e19600/0xd18a1efeeddb7baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7ba8 expref: 18 pid: 6501 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.799178:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca509e19600/0xd18a1efeeddb7baf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7ba8 expref: 18 pid: 6501 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.799189:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574276.799207:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574276.799216:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574276.799219:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574276.799225:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:3636:x1874407346686208:12345-0@lo:103: Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.799233:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574276.799267:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346686464:0@lo:103: 00000100:00100000:0.0:1787574276.799273:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574276.799282:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:3636:x1874407346686336:12345-0@lo:103: 00010000:00010000:0.0:1787574276.799291:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574276.799296:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca54216d000/0xd18a1efeeddb7b77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b70 expref: 16 pid: 6504 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574276.799305:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574276.799309:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca54216d000/0xd18a1efeeddb7b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b70 expref: 16 pid: 6504 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.799322:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca54216d000/0xd18a1efeeddb7b77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7b70 expref: 16 pid: 6504 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.799333:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574276.799340:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574276.799358:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:3636:x1874407346686336:12345-0@lo:103: Request processed in 76us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.799364:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574276.799374:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346686464 00000100:00100000:0.0:1787574276.799377:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346686464 00010000:00010000:0.0:1787574276.799395:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca54216da00/0xd18a1efeeddb7b00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7af9 expref: 15 pid: 6501 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.799407:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787574276.799412:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:3634:x1874407346686464:12345-0@lo:103: 00010000:00010000:0.0:1787574276.800091:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574276.800101:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca54216da00/0xd18a1efeeddb7b00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7af9 expref: 15 pid: 6501 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800114:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca54216da00/0xd18a1efeeddb7b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7af9 expref: 15 pid: 6501 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800126:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca54216da00/0xd18a1efeeddb7b00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7af9 expref: 15 pid: 6501 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800139:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800147:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800163:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800170:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800176:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800181:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800199:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574276.800203:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800211:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800236:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.800265:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574276.800309:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346685696:0@lo:103: 00010000:00010000:2.0:1787574276.800569:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.800643:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.800653:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787574276.800675:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787574276.802385:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:3634:x1874407346686464:12345-0@lo:103: Request processed in 2963us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.802400:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787574276.802503:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346686336:0@lo:103: 00000100:00100000:0.0:1787574276.802514:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346686208:0@lo:103: 00000100:00100000:2.0:1787574276.802980:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346686464:0@lo:103: 00000100:00100000:3.0:1787574276.812452:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:8417:x1874407346685184:12345-0@lo:253: Request processed in 66340us (67072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574276.812466:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787574276.814036:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346685184:0@lo:253: 10000000:01000000:2.0:1787574276.814067:0:8417:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787574276.814071:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574276.814073:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787574276.814074:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574276.814075:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787574276.814077:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574276.814078:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574276.814080:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574276.814081:0:8417:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787574276.814083:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574276.814084:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787574276.814107:0:8417:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca53bc3a000 from lustre-OST0000 10000000:01000000:2.0:1787574276.814140:0:8417:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787574276.814142:0:8417:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787574276.814150:0:8417:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ca5050d4d28 local copy 10000000:01000000:2.0:1787574276.814167:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787574276.814206:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.814217:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.814227:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574276.814267:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346686592:0@lo:101: 00000100:00100000:2.0:1787574276.814325:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574276.814373:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bf540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574276.815098:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346686592 00000100:00100000:1.0:1787574276.815109:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346686592 00000100:00100000:1.0:1787574276.815175:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787574276.815187:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+13:8417:x1874407346686592:12345-0@lo:101: 00010000:00010000:1.0:1787574276.815201:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574276.815223:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7c42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7c3b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.815287:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c3b expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.815298:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c3b expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.815307:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74600, rc 0) 00000100:00100000:1.0:1787574276.815373:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:8417:x1874407346686592:12345-0@lo:101: Request processed in 188us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.815379:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787574276.815496:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346686592:0@lo:101: 00010000:00010000:3.0:1787574276.815513:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574276.815523:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574276.815626:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5050fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346686720:0@lo:501: 00000100:00100000:3.0:1787574276.815659:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574276.815706:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510167d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574276.816733:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346686720 00000100:00100000:2.0:1787574276.816745:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346686720 00000100:00100000:2.0:1787574276.816796:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787574276.816803:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:8417:x1874407346686720:12345-0@lo:501: 00000100:00100000:2.0:1787574276.816906:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:8417:x1874407346686720:12345-0@lo:501: Request processed in 103us (1246us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574276.816912:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787574276.818490:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5050fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346686720:0@lo:501: 10000000:01000000:3.0:1787574276.818518:0:8417:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787574276.818573:0:8417:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787574276.818582:0:8417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574276.818593:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574276.818601:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574276.818626:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574276.818657:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1787574276.818663:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca53bc3a000 00010000:00010000:2.0:1787574276.818666:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574276.818670:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787574276.818680:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb200 already unused, calling callback (ffffffffc12c7c20) 10000000:01000000:3.0:1787574276.818681:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:00010000:2.0:1787574276.818686:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574276.818687:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787574276.818695:0:8417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787574276.818700:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787574276.818700:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574276.818733:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574276.818740:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574276.818740:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574276.818751:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574276.818835:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574276.818855:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5050fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346686848:0@lo:101: 00000100:00100000:3.0:1787574276.818911:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574276.819117:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510167900 going to sleep for 11 seconds 00000100:00100000:1.0:1787574276.819230:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346686848 00000100:00100000:1.0:1787574276.819270:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346686848 00000100:00100000:1.0:1787574276.819321:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787574276.819330:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:8417:x1874407346686848:12345-0@lo:101: 00010000:00010000:1.0:1787574276.819341:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574276.819355:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74400/0xd18a1efeeddb7c50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7c49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.819378:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74400/0xd18a1efeeddb7c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c49 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.819388:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74400/0xd18a1efeeddb7c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c49 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.819397:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74400, rc 0) 00000100:00100000:1.0:1787574276.819438:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346686848:12345-0@lo:101: Request processed in 109us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.819445:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787574276.819554:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5050fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346686848:0@lo:101: 00010000:00010000:2.0:1787574276.819565:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.819570:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.819576:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574276.819584:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.819697:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346687104:0@lo:501: 00000100:00100000:1.0:1787574276.819711:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346686976:0@lo:103: 00000100:00100000:0.0:1787574276.819729:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.819758:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574276.819788:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346687104 00000100:00100000:1.0:1787574276.819791:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346687104 00000100:00100000:1.0:1787574276.819820:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787574276.819827:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346687104:12345-0@lo:501: 00000100:00100000:1.0:1787574276.819915:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346687104:12345-0@lo:501: Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.819920:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787574276.819946:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.820015:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346687104:0@lo:501: 00000100:00100000:0.0:1787574276.820041:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346687232:0@lo:503: 00000100:00100000:0.0:1787574276.820088:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574276.820103:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.820107:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782c9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787574276.820116:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb200/0xd18a1efeeddb7c3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd18a1efeeddb7c42 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.820131:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574276.820133:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574276.820135:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574276.820149:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346686976 00000100:00100000:2.0:1787574276.820152:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346686976 00000100:00100000:2.0:1787574276.820194:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787574276.820201:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:3635:x1874407346686976:12345-0@lo:103: 00010000:00010000:2.0:1787574276.820210:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574276.820223:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7c42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7c3b expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.820233:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574276.820519:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346687232 00000100:00100000:3.0:1787574276.820532:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346687232 00000100:00100000:3.0:1787574276.820557:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787574276.820563:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346687232:12345-0@lo:503: 00000100:00100000:3.0:1787574276.820651:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346687232:12345-0@lo:503: Request processed in 87us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574276.820658:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787574276.820721:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346687232:0@lo:503: 00000040:00080000:0.0:1787574276.820960:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787574276.821035:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346687360:0@lo:502: 00000100:00100000:0.0:1787574276.821088:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.821124:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574276.821943:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346687360 00000100:00100000:3.0:1787574276.821951:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346687360 00000100:00100000:3.0:1787574276.822006:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787574276.822015:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346687360:12345-0@lo:502: 00000100:00100000:3.0:1787574276.822141:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346687360:12345-0@lo:502: Request processed in 125us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574276.822148:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787574276.825702:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346687360:0@lo:502: 00000040:00080000:0.0:1787574276.825993:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787574276.826024:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787574276.826037:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787574276.826061:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787574276.826079:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787574276.826090:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787574276.826124:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346687488:0@lo:502: 00000100:00100000:0.0:1787574276.826192:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.826235:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574276.826282:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346687488 00000100:00100000:3.0:1787574276.826291:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346687488 00000100:00100000:3.0:1787574276.826345:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787574276.826355:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346687488:12345-0@lo:502: 00000100:00100000:2.0:1787574276.826463:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:3635:x1874407346686976:12345-0@lo:103: Request processed in 6261us (6512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.826473:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574276.826490:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346687488:12345-0@lo:502: Request processed in 135us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574276.826500:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787574276.826580:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346687488:0@lo:502: 00000040:00080000:0.0:1787574276.826619:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787574276.826626:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787574276.827143:0:8440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787574276.827153:0:8440:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787574276.827161:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574276.827163:0:8440:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787574276.827169:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574276.827185:0:8440:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ca5350819b8) 00000020:00000080:2.0:1787574276.827220:0:8440:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787574276.827227:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787574276.827346:0:8440:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53bc3a000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787574276.827355:0:8440:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787574276.827361:0:8440:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd18a1efeeddb7c5e 00000100:00100000:1.0:1787574276.834723:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346686976:0@lo:103: 00010000:00010000:2.0:1787574276.838706:0:8440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1787574276.839013:0:8440:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787574276.844910:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787574276.845412:0:8440:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00000100:00100000:0.0:1787574276.849650:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346687872:0@lo:400: 00000100:00100000:2.0:1787574276.849720:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346687616:0@lo:41: 00000100:00100000:0.0:1787574276.849722:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.849765:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574276.849767:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.849774:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346688000:0@lo:400: 00000100:00100000:2.0:1787574276.849794:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346688128:0@lo:400: 00000100:00100000:0.0:1787574276.849830:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574276.849843:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574276.849864:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574276.849871:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346687744:0@lo:400: 00000100:00100000:0.0:1787574276.849876:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346687872 00000100:00100000:0.0:1787574276.849884:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346687872 00000100:00100000:2.0:1787574276.849895:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.849920:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346687616 00000100:00100000:0.0:1787574276.849924:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346687616 00000100:00100000:0.0:1787574276.849936:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346688128 00000100:00100000:0.0:1787574276.849938:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346688128 00000100:00100000:0.0:1787574276.849956:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574276.850155:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346687872:12345-0@lo:400: 00000100:00100000:0.0:1787574276.850212:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346687872:12345-0@lo:400: Request processed in 61us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.850289:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346687872:0@lo:400: 00000100:00100000:2.0:1787574276.850393:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346688000 00000100:00100000:2.0:1787574276.850399:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346688000 00000100:00100000:2.0:1787574276.850425:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346687744 00000100:00100000:2.0:1787574276.850428:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346687744 00000100:00100000:2.0:1787574276.850442:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574276.850449:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346688000:12345-0@lo:400: 00000100:00100000:2.0:1787574276.850490:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346688000:12345-0@lo:400: Request processed in 41us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.850497:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574276.850515:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574276.850530:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346687744:12345-0@lo:400: 00000100:00100000:2.0:1787574276.850566:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346687744:12345-0@lo:400: Request processed in 37us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.850572:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787574276.850603:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca4019eea00 x1874407346687744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574276.850614:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346687744:0@lo:400: 00010000:00080000:2.0:1787574276.850638:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca4019ed880 x1874407346688000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574276.850646:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346688000:0@lo:400: 00080000:10000000:3.0:1787574276.854711:0:8440:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787574276.856164:0:8440:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00000100:00100000:0.0:1787574276.858162:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574276.858228:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574276.858270:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346687616:12345-0@lo:41: 00000004:00000024:0.0:1787574276.858313:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787574276.858418:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346687616:12345-0@lo:41: Request processed in 179us (8651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.858425:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574276.858439:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574276.858446:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346688128:12345-0@lo:400: 00000100:00100000:0.0:1787574276.858478:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346688128:12345-0@lo:400: Request processed in 33us (8637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.858484:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574276.858730:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346687616:0@lo:41: 00000100:00100000:2.0:1787574276.858744:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346688128:0@lo:400: 00080000:10000000:3.0:1787574276.867693:0:8440:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787574276.876824:0:8440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787574276.876838:0:8440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574276.876845:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574276.876847:0:8440:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787574276.876852:0:8440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574276.876856:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574276.876857:0:8440:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787574276.876861:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574276.876862:0:8440:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787574276.876891:0:8440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574276.876894:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574276.876896:0:8440:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787574276.876899:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787574276.878892:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787574276.878935:0:8417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787574276.878949:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.878986:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574276.878994:0:8417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53bc3a000 from 1 10000000:01000000:0.0:1787574276.878997:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574276.879030:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.879037:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.879048:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.879083:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688256:0@lo:101: 00000100:00100000:0.0:1787574276.879149:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.879203:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e580c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574276.879298:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346688256 00000100:00100000:2.0:1787574276.879306:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346688256 00000100:00100000:2.0:1787574276.879356:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787574276.879366:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:8417:x1874407346688256:12345-0@lo:101: 00010000:00010000:2.0:1787574276.879378:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574276.879390:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb7c6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7c65 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.879415:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb7c6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c65 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.879425:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb7c6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c65 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.879446:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb200, rc 0) 00000100:00100000:2.0:1787574276.879488:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346688256:12345-0@lo:101: Request processed in 124us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.879494:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787574276.880459:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688256:0@lo:101: 00010000:00010000:0.0:1787574276.880480:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.880492:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.880670:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688384:0@lo:501: 00000100:00100000:0.0:1787574276.880714:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.880751:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e580c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574276.880854:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346688384 00000100:00100000:1.0:1787574276.880860:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346688384 00000100:00100000:1.0:1787574276.880893:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787574276.880902:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346688384:12345-0@lo:501: 00000100:00100000:1.0:1787574276.881014:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346688384:12345-0@lo:501: Request processed in 112us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.881028:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787574276.881362:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688384:0@lo:501: 00000100:00100000:0.0:1787574276.881393:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688512:0@lo:503: 00000100:00100000:0.0:1787574276.881437:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.881461:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e580c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574276.881479:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346688512 00000100:00100000:0.0:1787574276.881483:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346688512 00000100:00100000:0.0:1787574276.881510:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787574276.881518:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346688512:12345-0@lo:503: 00000100:00100000:0.0:1787574276.882380:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346688512:12345-0@lo:503: Request processed in 860us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.882389:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787574276.882445:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688512:0@lo:503: 00000040:00080000:0.0:1787574276.883177:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787574276.884028:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688640:0@lo:502: 00000100:00100000:0.0:1787574276.884100:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.884135:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e580c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574276.884485:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346688640 00000100:00100000:2.0:1787574276.884493:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346688640 00000100:00100000:2.0:1787574276.884546:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787574276.884555:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346688640:12345-0@lo:502: 00000100:00100000:2.0:1787574276.884674:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346688640:12345-0@lo:502: Request processed in 118us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.884681:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787574276.885748:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688640:0@lo:502: 00000040:00080000:0.0:1787574276.885994:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787574276.886023:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787574276.886066:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688768:0@lo:502: 00000100:00100000:0.0:1787574276.886124:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.886166:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e580c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574276.886678:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346688768 00000100:00100000:1.0:1787574276.886685:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346688768 00000100:00100000:1.0:1787574276.886730:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787574276.886738:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346688768:12345-0@lo:502: 00000100:00100000:1.0:1787574276.886847:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346688768:12345-0@lo:502: Request processed in 108us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.886856:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787574276.886988:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688768:0@lo:502: 00000040:00080000:0.0:1787574276.887034:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787574276.887044:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787574276.898013:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574276.898038:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574276.898041:0:8444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787574276.898048:0:8444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca53bc3a000 00000020:00000080:0.0:1787574276.898062:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787574276.898077:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574276.898080:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574276.898081:0:8444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787574276.898084:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787574276.898495:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787574276.898526:0:8417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574276.898551:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.898564:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574276.898688:0:8417:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787574276.898691:0:8417:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca53bc3a000 10000000:01000000:1.0:1787574276.898694:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca53bc3a000 10000000:01000000:1.0:1787574276.898698:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787574276.898703:0:8417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca53bc3a000 from 1 10000000:01000000:1.0:1787574276.898706:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787574276.898742:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.898751:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574276.898763:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574276.898795:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688896:0@lo:101: 00000100:00100000:1.0:1787574276.898861:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574276.898905:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574276.899034:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346688896 00000100:00100000:0.0:1787574276.899042:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346688896 00000100:00100000:0.0:1787574276.899098:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787574276.899108:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8417:x1874407346688896:12345-0@lo:101: 00010000:00010000:0.0:1787574276.899120:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574276.899132:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7c73 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.899156:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c73 expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.899165:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c73 expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.899173:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030a00, rc 0) 00000100:00100000:0.0:1787574276.899230:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:8417:x1874407346688896:12345-0@lo:101: Request processed in 124us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.899371:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787574276.899527:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346688896:0@lo:101: 00010000:00010000:2.0:1787574276.899542:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.899551:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574276.899725:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346689024:0@lo:501: 00000100:00100000:2.0:1787574276.899758:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574276.899789:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bf840 going to sleep for 11 seconds 00000100:00100000:0.0:1787574276.900072:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346689024 00000100:00100000:0.0:1787574276.900079:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346689024 00000100:00100000:0.0:1787574276.900152:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787574276.900161:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:8417:x1874407346689024:12345-0@lo:501: 00000100:00100000:0.0:1787574276.904946:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:8417:x1874407346689024:12345-0@lo:501: Request processed in 4776us (5177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.904973:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787574276.905296:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346689024:0@lo:501: 00000100:00100000:3.0:1787574276.905359:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5050ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346689152:0@lo:503: 00000100:00100000:3.0:1787574276.905427:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574276.910891:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346689152 00000100:00100000:1.0:1787574276.910907:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346689152 00000100:00100000:1.0:1787574276.910961:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787574276.911044:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:8417:x1874407346689152:12345-0@lo:503: 00000100:00100000:1.0:1787574276.911213:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:8417:x1874407346689152:12345-0@lo:503: Request processed in 172us (5786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.911221:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787574276.911514:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bf23240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574276.911538:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5050ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346689152:0@lo:503: 00000040:00080000:3.0:1787574276.911872:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574276.911960:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5050ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346689280:0@lo:502: 00000100:00100000:3.0:1787574276.912887:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574276.912929:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bf23240 going to sleep for 11 seconds 00000100:00100000:1.0:1787574276.913447:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346689280 00000100:00100000:1.0:1787574276.913456:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346689280 00000100:00100000:1.0:1787574276.913503:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787574276.913511:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:8417:x1874407346689280:12345-0@lo:502: 00000100:00100000:1.0:1787574276.913738:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:8417:x1874407346689280:12345-0@lo:502: Request processed in 226us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.913745:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787574276.913950:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5050ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346689280:0@lo:502: 00000040:00080000:2.0:1787574276.918289:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787574276.918342:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787574276.918355:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787574276.918366:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787574276.918379:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787574276.918416:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787574276.918430:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787574276.918440:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787574276.918451:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787574276.918461:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787574276.918471:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787574276.918481:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787574276.918491:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787574276.918502:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787574276.918512:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787574276.918522:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787574276.918533:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787574276.918543:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787574276.918553:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787574276.918563:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787574276.918803:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787574276.918833:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787574276.918846:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787574276.918858:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787574276.918870:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787574276.918884:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787574276.918896:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787574276.918906:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787574276.918916:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787574276.918927:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787574276.918937:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787574276.918947:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787574276.918957:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1787574276.918980:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1787574276.918991:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1787574276.919002:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1787574276.919012:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1787574276.919072:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346689408:0@lo:502: 00000100:00100000:2.0:1787574276.919144:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574276.919184:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574276.919421:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346689408 00000100:00100000:0.0:1787574276.919431:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346689408 00000100:00100000:0.0:1787574276.919477:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787574276.919486:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:8417:x1874407346689408:12345-0@lo:502: 00000100:00100000:0.0:1787574276.919636:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:8417:x1874407346689408:12345-0@lo:502: Request processed in 150us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.919644:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787574276.919794:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346689408:0@lo:502: 00000040:00080000:2.0:1787574276.919842:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787574276.919850:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787574276.920905:0:8445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787574276.920924:0:8445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ca53b14cd28) 00000020:00000080:3.0:1787574276.920948:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787574276.921214:0:8445:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53bc3a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787574276.921219:0:8445:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53bc3a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787574276.921221:0:8445:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53bc3a000 3 00010000:00080000:2.0:1787574276.924690:0:8445:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca401a1d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1787574276.927015:0:8445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1787574276.927233:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787574276.927448:0:8445:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787574276.927463:0:8445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd18a1efeeddb7c88 00000100:00080000:2.0:1787574276.927474:0:8445:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787574276.927479:0:8445:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ca401a1d000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574276.927514:0:8445:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca5045a9c00 x1874407346689536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574276.927541:0:8445:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1787574276.930396:0:8445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787574276.930427:0:8445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ca4022219b8) 00000020:00000080:2.0:1787574276.930452:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787574276.930540:0:8445:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53bc3a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787574276.930545:0:8445:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53bc3a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787574276.930548:0:8445:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53bc3a000 3 00000100:00100000:1.0:1787574276.931126:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346689536:0@lo:38: 00000100:00100000:1.0:1787574276.931199:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787574276.931405:0:8445:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca401a1b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.140@tcp at head 00000100:00100000:0.0:1787574276.932089:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346689536 00000100:00100000:0.0:1787574276.932100:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346689536 00000100:00100000:0.0:1787574276.932140:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574276.932148:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346689536:12345-0@lo:38: 00010000:00080000:0.0:1787574276.932174:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:0.0:1787574276.932218:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd18a1efeeddb7c96 00000004:00100000:0.0:1787574276.932235:0:6509:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574276.932351:0:6509:0:(import.c:65:import_set_state_nolock()) ffff9ca53be12000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574276.932426:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874407346689536:12345-0@lo:38: Request processed in 277us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.932433:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787574276.932483:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca5045a9c00 x1874407346689536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574276.932494:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787574276.932502:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787574276.932509:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787574276.932519:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787574276.932522:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787574276.932528:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346689536:0@lo:38: 00010000:00010000:2.0:1787574276.942127:0:8445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1787574276.942377:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787574276.942422:0:8445:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787574276.942435:0:8445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd18a1efeeddb7c9d 00000100:00080000:2.0:1787574276.942445:0:8445:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787574276.942451:0:8445:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9ca401a1b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574276.942489:0:8445:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca5045a8380 x1874407346689664/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574276.942514:0:8445:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787574276.946431:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1874407346689664:0@lo:38: 00000100:00100000:3.0:1787574276.946510:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574276.947098:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346689664 00000100:00100000:1.0:1787574276.947106:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346689664 00000100:00100000:1.0:1787574276.947147:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574276.947154:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1874407346689664:12345-0@lo:38: 00010000:00080000:1.0:1787574276.947181:0:6510:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:1.0:1787574276.947228:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd18a1efeeddb7ca4 00000004:00100000:1.0:1787574276.947661:0:6510:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787574276.947694:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9ca4010c0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574276.947760:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874407346689664:12345-0@lo:38: Request processed in 604us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574276.947768:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787574276.947869:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca5045a8380 x1874407346689664/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574276.947880:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574276.947887:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787574276.947894:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787574276.947899:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787574276.947901:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787574276.947906:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1874407346689664:0@lo:38: 00000040:00080000:2.0:1787574276.948999:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1787574276.951083:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787574276.951125:0:8417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787574276.951142:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.951154:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787574276.951210:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787574276.951212:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787574276.951214:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574276.951215:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574276.951216:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574276.951217:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574276.951219:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787574276.951220:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787574276.951221:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787574276.951223:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574276.951224:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787574276.951228:0:8417:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787574276.951230:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787574276.951231:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787574276.951233:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574276.951234:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574276.951235:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574276.951236:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574276.951237:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787574276.951273:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787574276.951274:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787574276.951275:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574276.951276:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787574276.951304:0:8417:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787574276.951331:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346689792:0@lo:253: 00000100:00100000:0.0:1787574276.951402:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574276.951440:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e58b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574276.951465:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346689792 00000100:00100000:0.0:1787574276.951472:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346689792 00000100:00100000:0.0:1787574276.951513:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787574276.951522:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:8417:x1874407346689792:12345-0@lo:253: 20000000:01000000:0.0:1787574276.951550:0:6504:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787574276.952040:0:6504:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787574276.967226:0:6504:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787574276.969174:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787574276.969721:0:6525:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787574276.969728:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787574276.969751:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.969769:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca509e18e00/0xd18a1efeeddb7ba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7b9a expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.969777:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca509e19e00/0xd18a1efeeddb7bbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7bb6 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.969784:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.969826:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca509e19e00/0xd18a1efeeddb7bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7bb6 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.969840:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca509e19e00/0xd18a1efeeddb7bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bb6 expref: 16 pid: 6504 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.969856:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ece00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346689920:0@lo:104: 00000100:00100000:0.0:1787574276.969930:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574276.970005:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca509e18e00/0xd18a1efeeddb7ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7b9a expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.970014:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca509e18e00/0xd18a1efeeddb7ba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b9a expref: 16 pid: 6503 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574276.970023:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346690048:0@lo:104: 00000100:00100000:0.0:1787574276.970043:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e58600 going to sleep for 11 seconds 00000100:00100000:2.0:1787574276.970180:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787574276.970199:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574276.970228:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346689920 00000100:00100000:2.0:1787574276.970235:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346689920 00000100:00100000:3.0:1787574276.970342:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346690048 00000100:00100000:3.0:1787574276.970347:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346690048 00000100:00100000:3.0:1787574276.970395:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787574276.970404:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6525:x1874407346690048:12345-0@lo:104: 00010000:00010000:3.0:1787574276.970417:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca509e18400/0xd18a1efeeddb7b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574276.970469:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574276.970475:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6525:x1874407346690048:12345-0@lo:104: Request processed in 72us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574276.970481:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574276.970557:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574276.970565:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca508b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6525:x1874407346689920:12345-0@lo:104: 00010000:00010000:2.0:1787574276.970735:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb7bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.970782:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787574276.970788:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca508b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6525:x1874407346689920:12345-0@lo:104: Request processed in 225us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.970794:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787574276.970835:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574276.970841:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca509e18400/0xd18a1efeeddb7b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.970849:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574276.970854:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e18400/0xd18a1efeeddb7b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.970863:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca509e18400/0xd18a1efeeddb7b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574276.970883:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e18400/0xd18a1efeeddb7b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574276.970889:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787574276.970921:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca509e18400/0xd18a1efeeddb7b9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.970928:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574276.970943:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca509e18400/0xd18a1efeeddb7b9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.970951:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca509e18400/0xd18a1efeeddb7b9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ba1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.970964:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574276.970967:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb7bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.970973:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19800 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574276.970976:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb7bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.970982:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb7bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574276.970988:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb7bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574276.970993:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787574276.971012:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb7bb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.971018:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574276.971034:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb7bb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.971040:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb7bb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7bbd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.971063:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574276.971065:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574276.971066:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574276.971085:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346690176:0@lo:103: 00000100:00100000:2.0:1787574276.971113:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574276.971155:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346690304:0@lo:103: 00000100:00100000:2.0:1787574276.971199:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574276.971232:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346690176 00000100:00100000:2.0:1787574276.971236:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346690176 00010000:00010000:3.0:1787574276.971356:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574276.971532:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:8417:x1874407346689792:12345-0@lo:253: Request processed in 20010us (20129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574276.971541:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787574276.971684:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8417:1874407346689792:0@lo:253: 10000000:01000000:3.0:1787574276.971695:0:8417:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787574276.971698:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787574276.971700:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787574276.971701:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574276.971702:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574276.971704:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574276.971705:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574276.971706:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574276.971708:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787574276.971709:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787574276.971711:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574276.971712:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787574276.971724:0:8417:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787574276.973058:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ece00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346689920:0@lo:104: 00000100:00100000:0.0:1787574276.973071:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346690048:0@lo:104: 00010000:00010000:0.0:1787574276.973090:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.973214:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca509e18e00/0xd18a1efeeddb7ba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b9a expref: 16 pid: 6503 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574276.973252:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346690304 00000100:00100000:2.0:1787574276.973702:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346690304 00010000:00010000:2.0:1787574276.973723:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca509e19e00/0xd18a1efeeddb7bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bb6 expref: 17 pid: 6504 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574276.973750:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574276.973758:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:3637:x1874407346690176:12345-0@lo:103: 00010000:00010000:2.0:1787574276.973770:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574276.973786:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca509e18e00/0xd18a1efeeddb7ba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b9a expref: 17 pid: 6503 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.973796:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca509e18e00/0xd18a1efeeddb7ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7b9a expref: 17 pid: 6503 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.973813:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca509e18e00/0xd18a1efeeddb7ba1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7b9a expref: 17 pid: 6503 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.973827:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574276.973886:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:3637:x1874407346690176:12345-0@lo:103: Request processed in 128us (2771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.973894:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574276.973911:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574276.973918:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:3634:x1874407346690304:12345-0@lo:103: 00010000:00010000:2.0:1787574276.973925:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574276.973929:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca509e19e00/0xd18a1efeeddb7bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bb6 expref: 15 pid: 6504 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.973938:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca509e19e00/0xd18a1efeeddb7bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7bb6 expref: 15 pid: 6504 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.973947:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca509e19e00/0xd18a1efeeddb7bbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7bb6 expref: 15 pid: 6504 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.973957:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.975443:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787574276.975483:0:6495:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024863812s 00010000:00010000:2.0:1787574276.975489:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.975496:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.975503:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.975511:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.975517:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574276.975521:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.975529:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.975545:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574276.975557:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574276.975629:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:3634:x1874407346690304:12345-0@lo:103: Request processed in 1708us (4426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574276.975637:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574276.975699:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346690176:0@lo:103: 00000100:00100000:2.0:1787574276.975733:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346690304:0@lo:103: 00010000:00010000:0.0:1787574276.975828:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.975838:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574276.975845:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787574276.978795:0:8417:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787574276.978999:0:8417:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787574276.979224:0:8417:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787574276.979421:0:8417:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787574276.979617:0:8417:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787574276.979819:0:8417:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787574276.981623:0:8417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787574276.989756:0:8417:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787574276.989766:0:8417:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787574276.989802:0:8417:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787574276.989843:0:8417:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787574276.989862:0:8417:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787574276.989881:0:8417:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787574276.993516:0:8417:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574276.993708:0:8417:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787574277.816299:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787574277.884430:0:8501:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574277.884659:0:8501:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574278.837539:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787574279.605931:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787574279.605948:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca526758000 from 30 10000000:01000000:2.0:1787574279.605952:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787574279.605998:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.606010:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.606021:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574279.606056:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346690432:0@lo:101: 00000100:00100000:2.0:1787574279.606123:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.606174:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50b71d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787574279.606236:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346690432 00000100:00100000:1.0:1787574279.606270:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346690432 00000100:00100000:1.0:1787574279.606330:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787574279.606339:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:6506:x1874407346690432:12345-0@lo:101: 00010000:00010000:1.0:1787574279.606353:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574279.606365:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb7cb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7cb2 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574279.606387:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb7cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cb2 expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574279.606397:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb7cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cb2 expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574279.606406:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74200, rc 0) 00000100:00100000:1.0:1787574279.606446:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346690432:12345-0@lo:101: Request processed in 108us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574279.606467:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787574279.606690:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346690432:0@lo:101: 00010000:00010000:2.0:1787574279.606705:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.606714:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574279.606773:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346690560:0@lo:501: 00000100:00100000:2.0:1787574279.606802:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.606832:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50b71d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787574279.606955:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346690560 00000100:00100000:1.0:1787574279.606961:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346690560 00000100:00100000:1.0:1787574279.606991:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787574279.606998:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346690560:12345-0@lo:501: 00000100:00100000:1.0:1787574279.607126:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346690560:12345-0@lo:501: Request processed in 128us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574279.607150:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787574279.607276:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346690560:0@lo:501: 00000100:00100000:2.0:1787574279.607305:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346690688:0@lo:503: 00000100:00100000:2.0:1787574279.607347:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.607378:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50b71d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787574279.607392:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346690688 00000100:00100000:2.0:1787574279.607396:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346690688 00000100:00100000:2.0:1787574279.607419:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787574279.607425:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346690688:12345-0@lo:503: 00000100:00100000:2.0:1787574279.607640:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346690688:12345-0@lo:503: Request processed in 215us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574279.607647:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787574279.607804:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346690688:0@lo:503: 00000100:00100000:1.0:1787574279.610470:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8603:1874407346690816:0@lo:502: 00000100:00100000:1.0:1787574279.610547:0:8603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574279.610592:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53be973c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574279.610767:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346690816 00000100:00100000:2.0:1787574279.610775:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346690816 00000100:00100000:2.0:1787574279.610827:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787574279.610836:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8603:x1874407346690816:12345-0@lo:502: 00000100:00100000:2.0:1787574279.610973:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8603:x1874407346690816:12345-0@lo:502: Request processed in 137us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574279.610983:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787574279.611153:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8603:1874407346690816:0@lo:502: 00000100:00100000:1.0:1787574279.611203:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8603:1874407346690944:0@lo:502: 00000100:00100000:1.0:1787574279.611268:0:8603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574279.611282:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53be973c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574279.613637:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346690944 00000100:00100000:2.0:1787574279.613650:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346690944 00000100:00100000:2.0:1787574279.613719:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787574279.613729:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8603:x1874407346690944:12345-0@lo:502: 00000100:00100000:2.0:1787574279.613868:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:8603:x1874407346690944:12345-0@lo:502: Request processed in 139us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574279.613875:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787574279.614127:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8603:1874407346690944:0@lo:502: 00000040:00080000:1.0:1787574279.614163:0:8603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787574279.615789:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787574279.615824:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574279.615835:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.615847:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574279.615864:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787574279.615866:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca526758000 from 5 10000000:01000000:2.0:1787574279.615869:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787574279.615909:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.615917:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.615928:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574279.616021:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346691072:0@lo:101: 00000100:00100000:2.0:1787574279.616090:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.616140:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574279.616214:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346691072 00000100:00100000:1.0:1787574279.616222:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346691072 00000100:00100000:1.0:1787574279.616292:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787574279.616302:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346691072:12345-0@lo:101: 00010000:00010000:1.0:1787574279.616313:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574279.616326:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7cc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7cc0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574279.616349:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cc0 expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574279.616358:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cc0 expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574279.616367:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74000, rc 0) 00000100:00100000:1.0:1787574279.616410:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346691072:12345-0@lo:101: Request processed in 110us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574279.616416:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787574279.616577:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346691072:0@lo:101: 00010000:00010000:2.0:1787574279.616591:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.616599:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574279.616646:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346691200:0@lo:256: 00000100:00100000:2.0:1787574279.617340:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.617414:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574279.624356:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346691200 00000100:00100000:1.0:1787574279.624374:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346691200 00000100:00100000:1.0:1787574279.624441:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787574279.624462:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346691200:12345-0@lo:256: 20000000:01000000:1.0:1787574279.624493:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787574279.624515:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787574279.624517:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787574279.625041:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346691200:12345-0@lo:256: Request processed in 219us (7332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574279.625050:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787574279.625597:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346691200:0@lo:256: 10000000:01000000:2.0:1787574279.625654:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574279.625680:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.625692:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574279.625704:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787574279.625707:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1787574279.625709:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787574279.625741:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.625749:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.625757:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574279.625775:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346691328:0@lo:101: 00000100:00100000:2.0:1787574279.625820:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.625849:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.626598:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346691328 00000100:00100000:0.0:1787574279.626607:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346691328 00000100:00100000:0.0:1787574279.626654:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787574279.626665:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346691328:12345-0@lo:101: 00010000:00010000:0.0:1787574279.626700:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574279.626714:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7cce expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.626739:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cce expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.626749:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cce expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.626758:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031600, rc 0) 00000100:00100000:0.0:1787574279.626800:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346691328:12345-0@lo:101: Request processed in 137us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.626806:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787574279.627232:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346691328:0@lo:101: 00010000:00010000:2.0:1787574279.627275:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.627285:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574279.627348:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346691456:0@lo:501: 00000100:00100000:2.0:1787574279.627388:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.627415:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574279.627432:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346691456 00000100:00100000:2.0:1787574279.627435:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346691456 00000100:00100000:2.0:1787574279.627606:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787574279.627615:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346691456:12345-0@lo:501: 00000100:00100000:2.0:1787574279.627754:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346691456:12345-0@lo:501: Request processed in 141us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574279.627761:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787574279.634610:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346691456:0@lo:501: 00000100:00100000:2.0:1787574279.635425:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346691584:0@lo:503: 00000100:00100000:2.0:1787574279.635570:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.635641:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.636719:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346691584 00000100:00100000:0.0:1787574279.636729:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346691584 00000100:00100000:0.0:1787574279.636784:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787574279.636794:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346691584:12345-0@lo:503: 00000100:00100000:0.0:1787574279.636951:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346691584:12345-0@lo:503: Request processed in 145us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.636960:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787574279.637589:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346691584:0@lo:503: 00000100:00100000:2.0:1787574279.638544:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8605:1874407346691712:0@lo:502: 00000100:00100000:2.0:1787574279.638604:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.639182:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.639316:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346691712 00000100:00100000:0.0:1787574279.639323:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346691712 00000100:00100000:0.0:1787574279.639367:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787574279.639375:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:8605:x1874407346691712:12345-0@lo:502: 00000100:00100000:0.0:1787574279.639498:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:8605:x1874407346691712:12345-0@lo:502: Request processed in 122us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.639505:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787574279.641721:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8605:1874407346691712:0@lo:502: 00000020:01000000:2.0:1787574279.641760:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787574279.641768:0:8605:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787574279.641775:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574279.641777:0:8605:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787574279.641783:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787574279.641786:0:8605:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:2.0:1787574279.641810:0:8605:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787574279.641812:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574279.641830:0:8605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ca402223370) 00000020:00000080:2.0:1787574279.641852:0:8605:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787574279.641857:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787574279.642082:0:8605:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787574279.642090:0:8605:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787574279.642098:0:8605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb7ce3 00010000:00080000:2.0:1787574279.642126:0:8605:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca535270000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1787574279.642369:0:8605:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787574279.664576:0:8605:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787574279.664603:0:8605:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787574279.664820:0:8605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574279.665194:0:8605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574279.665305:0:8605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787574279.665391:0:8605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787574279.666412:0:8608:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787574279.666418:0:8608:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787574279.670854:0:8605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787574279.670869:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787574279.670913:0:8605:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787574279.670952:0:8605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb7cea 00000100:00080000:2.0:1787574279.670963:0:8605:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787574279.670969:0:8605:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ca535270000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574279.671005:0:8605:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53bf48e00 x1874407346691840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574279.671039:0:8605:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787574279.671108:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574279.671113:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574279.671115:0:8605:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787574279.671118:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574279.671121:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574279.671122:0:8605:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787574279.671137:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787574279.671139:0:8605:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787574279.671168:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8605:1874407346691968:0@lo:502: 00000100:00100000:2.0:1787574279.671279:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.671319:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.671484:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346691968 00000100:00100000:0.0:1787574279.671491:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346691968 00000100:00100000:0.0:1787574279.671533:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787574279.671543:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:8605:x1874407346691968:12345-0@lo:502: 00000100:00100000:0.0:1787574279.671661:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:8605:x1874407346691968:12345-0@lo:502: Request processed in 118us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.671669:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787574279.671712:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346692480:0@lo:400: 00000100:00100000:0.0:1787574279.671745:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.671769:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787574279.671775:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346692096:0@lo:400: 00000100:00100000:0.0:1787574279.671798:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.671822:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346692608:0@lo:400: 00000100:00100000:0.0:1787574279.671841:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.671871:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346692224:0@lo:400: 00000100:00100000:0.0:1787574279.671894:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.671909:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346692736:0@lo:400: 00000100:00100000:2.0:1787574279.672196:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346692352:0@lo:400: 00000100:00100000:3.0:1787574279.672282:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346691840:0@lo:8: 00000100:00100000:1.0:1787574279.672585:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346692096 00000100:00100000:1.0:1787574279.672591:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346692096 00000100:00100000:1.0:1787574279.672623:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346692608 00000100:00100000:1.0:1787574279.672626:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346692608 00000100:00100000:1.0:1787574279.672650:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787574279.672658:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346692096:12345-0@lo:400: 00000100:00100000:2.0:1787574279.672718:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787574279.672745:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574279.672771:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8605:1874407346691968:0@lo:502: 00000020:01000000:2.0:1787574279.672801:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574279.672808:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574279.672810:0:8605:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787574279.672814:0:8605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:3.0:1787574279.672972:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.673082:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346691840 00000100:00100000:2.0:1787574279.673087:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346691840 00000100:00100000:2.0:1787574279.673117:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574279.673122:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1874407346691840:12345-0@lo:8: 00010000:00080000:2.0:1787574279.673155:0:8423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1787574279.673183:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb7cf1 00002000:00100000:2.0:1787574279.673227:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ca401a1b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787574279.673232:0:8423:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1787574279.673235:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787574279.673334:0:8423:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787574279.673670:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787574279.673696:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574279.673753:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1874407346691840:12345-0@lo:8: Request processed in 629us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574279.673761:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787574279.673806:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf48e00 x1874407346691840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574279.673816:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574279.673823:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787574279.673840:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787574279.673846:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787574279.673849:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca535270000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787574279.673860:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787574279.673866:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346691840:0@lo:8: 00000004:00080000:2.0:1787574279.673887:0:8608:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787574279.673939:0:8608:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 218856698978ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787574279.673946:0:8608:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787574279.674448:0:8609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8609:1874407346692864:0@lo:700: 00000100:00100000:3.0:1787574279.674500:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574279.674525:0:8609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5078b4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574279.674637:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346692864 00000100:00100000:2.0:1787574279.674643:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346692864 00000100:00100000:2.0:1787574279.674691:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574279.674700:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8609:x1874407346692864:12345-0@lo:700: 00000100:00100000:2.0:1787574279.674730:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8432:1874407346692992:0@lo:700: 00000100:00100000:2.0:1787574279.674763:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574279.674781:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.674846:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.674882:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346692480 00000100:00100000:0.0:1787574279.674886:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346692480 00000100:00100000:0.0:1787574279.674906:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346692224 00000100:00100000:0.0:1787574279.674909:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346692224 00000100:00100000:0.0:1787574279.674923:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574279.674929:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346692480:12345-0@lo:400: 00000100:00100000:0.0:1787574279.674980:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346692480:12345-0@lo:400: Request processed in 51us (3234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.674987:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574279.675008:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574279.675015:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346692224:12345-0@lo:400: 00000100:00100000:0.0:1787574279.675065:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346692224:12345-0@lo:400: Request processed in 50us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.675070:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574279.675089:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787574279.675096:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:01000000:0.0:1787574279.675114:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1787574279.675152:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787574279.675161:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.675172:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574279.675183:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787574279.675185:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca5109bd800 from 30 10000000:01000000:0.0:1787574279.675188:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574279.675213:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.675221:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.675229:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574279.675263:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346693120:0@lo:101: 00000100:00100000:0.0:1787574279.675291:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.675314:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e58300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.675351:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346692224:0@lo:400: 00000100:00100000:2.0:1787574279.675631:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346692480:0@lo:400: 00000100:00100000:0.0:1787574279.676689:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346692352 00000100:00100000:0.0:1787574279.676698:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346692352 00000100:00100000:0.0:1787574279.676734:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787574279.676742:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346692736 00000100:00100000:0.0:1787574279.676745:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346692736 00000100:00100000:0.0:1787574279.676762:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787574279.676770:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574279.676779:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346692608:12345-0@lo:400: 00000100:00100000:0.0:1787574279.676849:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346692608:12345-0@lo:400: Request processed in 72us (5007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.676855:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574279.676870:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787574279.676876:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787574279.676881:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346692352:12345-0@lo:400: 00000100:00100000:0.0:1787574279.676917:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346692352:12345-0@lo:400: Request processed in 35us (4198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.676922:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787574279.676933:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787574279.676946:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787574279.676952:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346692736:12345-0@lo:400: 00000100:00100000:0.0:1787574279.676984:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346692736:12345-0@lo:400: Request processed in 32us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.676989:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787574279.677036:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019eca80 x1874407346692608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574279.677049:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346692608:0@lo:400: 00010000:00080000:0.0:1787574279.677098:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019ef100 x1874407346692352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574279.677108:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346692352:0@lo:400: 00000100:00080000:3.0:1787574279.677227:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574279.677233:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574279.677289:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346692992 00000100:00100000:3.0:1787574279.677294:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346692992 00000100:00100000:3.0:1787574279.677322:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574279.677329:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8432:x1874407346692992:12345-0@lo:700: 00010000:00080000:0.0:1787574279.678009:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019ee300 x1874407346692736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574279.678023:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346692736:0@lo:400: 00000100:00100000:2.0:1787574279.678353:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346693120 00000100:00100000:2.0:1787574279.678360:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346693120 00000100:00100000:2.0:1787574279.678400:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787574279.678408:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346693120:12345-0@lo:101: 00010000:00010000:2.0:1787574279.678419:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574279.678436:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb7cff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7cf8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.678561:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb7cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cf8 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.678573:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb7cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cf8 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574279.678591:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa200, rc 0) 00000100:00100000:2.0:1787574279.678651:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346693120:12345-0@lo:101: Request processed in 244us (3358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574279.678658:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000004:00080000:3.0:1787574279.679591:0:7440:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787574279.679718:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346693120:0@lo:101: 00010000:00010000:0.0:1787574279.679738:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.679749:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574279.679831:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346693248:0@lo:501: 00000100:00100000:0.0:1787574279.679873:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.679959:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e58300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574279.681162:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346692096:12345-0@lo:400: Request processed in 8500us (9357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574279.681175:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787574279.681304:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019efb80 x1874407346692096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574279.681318:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346692096:0@lo:400: 00000100:00100000:3.0:1787574279.696656:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346693248 00000100:00100000:3.0:1787574279.696669:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346693248 00000100:00100000:2.0:1787574279.696803:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787574279.696813:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346693248:12345-0@lo:501: 00000100:00100000:2.0:1787574279.697011:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346693248:12345-0@lo:501: Request processed in 198us (17137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574279.697018:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787574279.697406:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346693248:0@lo:501: 00000100:00100000:0.0:1787574279.697458:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346693376:0@lo:503: 00000100:00100000:0.0:1787574279.697512:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.697544:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518e58300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.697557:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346693376 00000100:00100000:0.0:1787574279.697561:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346693376 00000100:00100000:0.0:1787574279.697586:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787574279.697593:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346693376:12345-0@lo:503: 00000100:00100000:0.0:1787574279.697678:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346693376:12345-0@lo:503: Request processed in 84us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.697691:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787574279.697731:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346693376:0@lo:503: 00000100:00100000:0.0:1787574279.700407:0:8612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8612:1874407346693504:0@lo:502: 00000100:00100000:0.0:1787574279.700492:0:8612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.700526:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346693504 00000100:00100000:0.0:1787574279.700532:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346693504 00000100:00100000:0.0:1787574279.700569:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787574279.700578:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:8612:x1874407346693504:12345-0@lo:502: 00000100:00100000:0.0:1787574279.700681:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:8612:x1874407346693504:12345-0@lo:502: Request processed in 104us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.700689:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787574279.700732:0:8612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.700751:0:8612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8612:1874407346693504:0@lo:502: 00000100:00100000:0.0:1787574279.700797:0:8612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8612:1874407346693632:0@lo:502: 00000100:00100000:0.0:1787574279.700827:0:8612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.700841:0:8612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574279.700935:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346693632 00000100:00100000:3.0:1787574279.701015:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346693632 00000100:00100000:3.0:1787574279.701058:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787574279.701065:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:8612:x1874407346693632:12345-0@lo:502: 00000100:00100000:3.0:1787574279.701146:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:8612:x1874407346693632:12345-0@lo:502: Request processed in 82us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574279.701161:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787574279.701371:0:8612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8612:1874407346693632:0@lo:502: 00000040:00080000:0.0:1787574279.701394:0:8612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787574279.701459:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787574279.701477:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787574279.701487:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.701498:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574279.701518:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787574279.701522:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca5109bd800 from 5 10000000:01000000:0.0:1787574279.701524:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787574279.701548:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.701556:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.701566:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574279.701579:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346693760:0@lo:101: 00000100:00100000:0.0:1787574279.701604:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.701624:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.701637:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346693760 00000100:00100000:0.0:1787574279.701641:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346693760 00000100:00100000:0.0:1787574279.701664:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787574279.701671:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346693760:12345-0@lo:101: 00010000:00010000:0.0:1787574279.701679:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574279.701690:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7d0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7d06 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.701708:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d06 expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.701719:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d06 expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.701739:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030800, rc 0) 00000100:00100000:0.0:1787574279.701768:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346693760:12345-0@lo:101: Request processed in 96us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.701774:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787574279.701802:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346693760:0@lo:101: 00010000:00010000:0.0:1787574279.701813:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.701822:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574279.701859:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346693888:0@lo:256: 00000100:00100000:0.0:1787574279.701901:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.701914:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.701925:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346693888 00000100:00100000:0.0:1787574279.701928:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346693888 00000100:00100000:0.0:1787574279.702156:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787574279.702164:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346693888:12345-0@lo:256: 20000000:01000000:0.0:1787574279.702177:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787574279.702191:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787574279.702195:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787574279.702294:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346693888:12345-0@lo:256: Request processed in 131us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.702301:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787574279.702333:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346693888:0@lo:256: 10000000:01000000:0.0:1787574279.702370:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787574279.702379:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.702387:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574279.702395:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787574279.702397:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787574279.702400:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787574279.702428:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.702435:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.702444:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574279.702456:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346694016:0@lo:101: 00000100:00100000:0.0:1787574279.702480:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.702504:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574279.702621:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346694016 00000100:00100000:3.0:1787574279.702626:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346694016 00000100:00100000:3.0:1787574279.702659:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787574279.702666:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346694016:12345-0@lo:101: 00010000:00010000:3.0:1787574279.702675:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574279.702684:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be99e00/0xd18a1efeeddb7d1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7d14 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574279.702701:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be99e00/0xd18a1efeeddb7d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d14 expref: 20 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574279.702709:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be99e00/0xd18a1efeeddb7d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d14 expref: 20 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574279.702716:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99e00, rc 0) 00000100:00100000:3.0:1787574279.702743:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346694016:12345-0@lo:101: Request processed in 78us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574279.702749:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787574279.702891:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346694016:0@lo:101: 00010000:00010000:0.0:1787574279.702903:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.702911:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574279.703084:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346694144:0@lo:501: 00000100:00100000:0.0:1787574279.703119:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.703134:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.703146:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346694144 00000100:00100000:0.0:1787574279.703149:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346694144 00000100:00100000:0.0:1787574279.703182:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787574279.703189:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346694144:12345-0@lo:501: 00000100:00100000:0.0:1787574279.703320:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346694144:12345-0@lo:501: Request processed in 132us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.703327:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787574279.703356:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346694144:0@lo:501: 00000100:00100000:0.0:1787574279.703379:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346694272:0@lo:503: 00000100:00100000:0.0:1787574279.703418:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.703436:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.703447:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346694272 00000100:00100000:0.0:1787574279.703450:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346694272 00000100:00100000:0.0:1787574279.703470:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787574279.703476:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346694272:12345-0@lo:503: 00000100:00100000:0.0:1787574279.703547:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346694272:12345-0@lo:503: Request processed in 70us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.703553:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787574279.703592:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346694272:0@lo:503: 00000100:00100000:0.0:1787574279.703749:0:8614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8614:1874407346694400:0@lo:502: 00000100:00100000:0.0:1787574279.703778:0:8614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.703792:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346694400 00000100:00100000:0.0:1787574279.703795:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346694400 00000100:00100000:0.0:1787574279.703812:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787574279.703823:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:8614:x1874407346694400:12345-0@lo:502: 00000100:00100000:0.0:1787574279.703881:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:8614:x1874407346694400:12345-0@lo:502: Request processed in 58us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.703901:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787574279.703927:0:8614:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.703937:0:8614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8614:1874407346694400:0@lo:502: 00000020:01000000:0.0:1787574279.704716:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787574279.704723:0:8614:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787574279.704730:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574279.704732:0:8614:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787574279.704740:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787574279.704745:0:8614:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:0.0:1787574279.704770:0:8614:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787574279.704772:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787574279.704787:0:8614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ca5350b8000) 00000020:00000080:0.0:1787574279.704813:0:8614:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787574279.704819:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787574279.707095:0:8614:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787574279.707106:0:8614:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787574279.707118:0:8614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb7d29 00010000:00080000:0.0:1787574279.707154:0:8614:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca536beb000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1787574279.711224:0:8614:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:1.0:1787574279.713188:0:6516:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:01000000:0.0:1787574279.723586:0:8614:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787574279.723609:0:8614:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787574279.723810:0:8614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574279.724041:0:8614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574279.724143:0:8614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787574279.724232:0:8614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:0.0:1787574279.734134:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8432:x1874407346692992:12345-0@lo:700: Request processed in 56785us (59349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.734160:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:3.0:1787574279.734574:0:8615:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574279.734579:0:8615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00010000:00080000:1.0:1787574279.734684:0:8432:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf48e00 x1874407346692992/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787574295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574279.734701:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8432:1874407346692992:0@lo:700: 40000000:02000000:1.0:1787574279.734715:0:8432:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000020:00000080:0.0:1787574279.740105:0:8614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787574279.740122:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787574279.740175:0:8614:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787574279.740202:0:8614:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb7d30 00000100:00080000:0.0:1787574279.740213:0:8614:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787574279.740219:0:8614:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ca536beb000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574279.740294:0:8614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca4019ec700 x1874407346694528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574279.740317:0:8614:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787574279.740391:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574279.740395:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574279.740397:0:8614:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787574279.740400:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574279.740404:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574279.740405:0:8614:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787574279.740408:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787574279.740409:0:8614:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787574279.740437:0:8614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8614:1874407346694656:0@lo:502: 00000100:00100000:0.0:1787574279.740515:0:8614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.740548:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346694656 00000100:00100000:0.0:1787574279.740554:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346694656 00000100:00100000:0.0:1787574279.740593:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787574279.740602:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:8614:x1874407346694656:12345-0@lo:502: 00000100:00100000:0.0:1787574279.740715:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:8614:x1874407346694656:12345-0@lo:502: Request processed in 113us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.740722:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787574279.740769:0:8614:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.740798:0:8614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:8614:1874407346694656:0@lo:502: 00000020:01000000:0.0:1787574279.740822:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574279.740826:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574279.740828:0:8614:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787574279.740833:0:8614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787574279.740883:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787574279.740900:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787574279.740909:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.740919:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574279.740928:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787574279.740931:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ca5050d4d28 from 1 10000000:01000000:0.0:1787574279.740934:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787574279.740957:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.740965:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.740974:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574279.740986:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346694784:0@lo:101: 00000100:00100000:0.0:1787574279.741013:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.741045:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.741061:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346694784 00000100:00100000:0.0:1787574279.741065:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346694784 00000100:00100000:0.0:1787574279.741097:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787574279.741103:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346694784:12345-0@lo:101: 00010000:00010000:0.0:1787574279.741112:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574279.741123:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca535c11a00/0xd18a1efeeddb7d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7d37 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.741142:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c11a00/0xd18a1efeeddb7d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d37 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.741152:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca535c11a00/0xd18a1efeeddb7d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d37 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.741163:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11a00, rc 0) 00000100:00100000:0.0:1787574279.741192:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346694784:12345-0@lo:101: Request processed in 88us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.741197:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787574279.741228:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346694784:0@lo:101: 00010000:00010000:0.0:1787574279.741261:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.741271:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574279.741316:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346694912:0@lo:501: 00000100:00100000:0.0:1787574279.741339:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.741356:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574279.741368:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346694912 00000100:00100000:0.0:1787574279.741371:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346694912 00000100:00100000:0.0:1787574279.741392:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787574279.741405:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346694912:12345-0@lo:501: 00000100:00100000:0.0:1787574279.741466:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346694912:12345-0@lo:501: Request processed in 62us (126us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787574279.741472:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787574279.741498:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346694912:0@lo:501: 10000000:01000000:0.0:1787574279.741515:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787574279.741520:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574279.741527:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574279.741669:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346694528:0@lo:8: 00000100:00100000:3.0:1787574279.741719:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.742483:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346694528 00000100:00100000:0.0:1787574279.742489:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346694528 00000100:00100000:0.0:1787574279.742524:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574279.742529:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3633:x1874407346694528:12345-0@lo:8: 00010000:00080000:0.0:1787574279.742552:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1787574279.742581:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb7d45 00002000:00100000:0.0:1787574279.742595:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ca536bea000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787574279.742600:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787574279.742603:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787574279.742671:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787574279.742694:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9ca536beb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574279.742853:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1874407346694528:12345-0@lo:8: Request processed in 321us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.742859:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787574279.750169:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019ec700 x1874407346694528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574279.750185:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574279.750197:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787574279.750224:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787574279.750231:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787574279.750235:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca536beb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787574279.750278:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787574279.750285:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346694528:0@lo:8: 00000004:00080000:1.0:1787574279.763380:0:8615:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787574279.763473:0:8615:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 218946231960ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787574279.763479:0:8615:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787574279.765265:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787574279.765480:0:8616:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787574279.765508:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8616:1874407346695168:0@lo:7: 00000100:00100000:1.0:1787574279.765580:0:8616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574279.765617:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53be97d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574279.765684:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346695168 00000100:00100000:3.0:1787574279.765691:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346695168 00000100:00100000:3.0:1787574279.765758:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574279.765767:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8616:x1874407346695168:12345-0@lo:7: 00000100:00080000:1.0:1787574279.769092:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574279.770018:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346695040:0@lo:13: 00000100:00100000:1.0:1787574279.770114:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.770603:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346695040 00000100:00100000:0.0:1787574279.770613:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346695040 00000100:00100000:0.0:1787574279.770661:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574279.770672:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1874407346695040:12345-0@lo:13: 00002000:00000024:0.0:1787574279.770707:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923890176 avail 3692367872 00000100:00100000:0.0:1787574279.770768:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1874407346695040:12345-0@lo:13: Request processed in 97us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.770774:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787574279.772977:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca504598380 x1874407346695040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574279.773003:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346695040:0@lo:13: 00002000:00080000:3.0:1787574279.780235:0:8425:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787574279.780276:0:8425:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787574279.780395:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8616:x1874407346695168:12345-0@lo:7: Request processed in 14624us (14810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574279.780407:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787574279.780892:0:8616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca50459a680 x1874407346695168/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787574295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574279.780909:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8616:1874407346695168:0@lo:7: 00000004:00080000:1.0:1787574279.780923:0:8616:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787574279.780975:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8616:1874407346695296:0@lo:5: 00000100:00100000:1.0:1787574279.781014:0:8616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574279.781052:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53be97d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574279.785180:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346695296 00000100:00100000:2.0:1787574279.785197:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346695296 00000100:00100000:2.0:1787574279.785278:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574279.785290:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8616:x1874407346695296:12345-0@lo:5: 00002000:00080000:2.0:1787574279.785321:0:8423:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787574279.785326:0:8423:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00100000:0.0:1787574279.795131:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787574279.795144:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787574279.796546:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8609:x1874407346692864:12345-0@lo:700: Request processed in 121837us (122036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.796566:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787574279.797296:0:8609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8f480 x1874407346692864/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787574295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574279.797312:0:8609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8609:1874407346692864:0@lo:700: 00000004:00080000:3.0:1787574279.807548:0:8609:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787574279.807583:0:8609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8609:1874407346695552:0@lo:7: 00000100:00100000:3.0:1787574279.807669:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574279.807728:0:8609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5078b4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574279.807748:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787574279.807755:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787574279.808716:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574279.808753:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346695424:0@lo:13: 00000100:00100000:1.0:1787574279.808811:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574279.810897:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346695424 00000100:00100000:0.0:1787574279.810914:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346695424 00000100:00100000:0.0:1787574279.810978:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574279.810990:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346695424:12345-0@lo:13: 00002000:00000024:0.0:1787574279.811021:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923890176 avail 3692367872 00000100:00100000:0.0:1787574279.811114:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346695424:12345-0@lo:13: Request processed in 126us (2302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574279.811122:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787574279.811203:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8f480 x1874407346695424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574279.811223:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346695424:0@lo:13: 00000100:00100000:3.0:1787574279.826861:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346695552 00000100:00100000:3.0:1787574279.826873:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346695552 00000100:00100000:3.0:1787574279.827541:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574279.827553:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8609:x1874407346695552:12345-0@lo:7: 00002000:00080000:3.0:1787574279.848809:0:8619:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787574279.848820:0:8619:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787574279.848916:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8609:x1874407346695552:12345-0@lo:7: Request processed in 21360us (41242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574279.848927:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787574279.848983:0:8609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8ce00 x1874407346695552/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787574295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574279.848999:0:8609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8609:1874407346695552:0@lo:7: 00000004:00080000:3.0:1787574279.849014:0:8609:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000001:00080000:2.0:1787574279.854863:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1787574279.855316:0:8609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8609:1874407346695680:0@lo:5: 00000100:00100000:3.0:1787574279.855389:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574279.855430:0:8609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574279.855451:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346695680 00000100:00100000:3.0:1787574279.855457:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346695680 00000100:00100000:3.0:1787574279.855505:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574279.855514:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8609:x1874407346695680:12345-0@lo:5: 00002000:00080000:3.0:1787574279.855541:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787574279.855581:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8609:x1874407346695680:12345-0@lo:5: Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574279.855587:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787574279.855627:0:8609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8ce00 x1874407346695680/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574279.855642:0:8609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8609:1874407346695680:0@lo:5: 00000004:00080000:3.0:1787574279.855653:0:8609:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787574279.855677:0:8609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8609:1874407346695808:0@lo:5: 00000100:00100000:3.0:1787574279.855718:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574279.855732:0:8609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574279.855742:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346695808 00000100:00100000:3.0:1787574279.855745:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346695808 00000100:00100000:3.0:1787574279.855766:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574279.855772:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8609:x1874407346695808:12345-0@lo:5: 00002000:00080000:3.0:1787574279.855797:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00010000:00010000:2.0:1787574279.864322:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574279.873767:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8609:x1874407346695808:12345-0@lo:5: Request processed in 17988us (18041us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787574279.873779:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787574279.873976:0:8609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8ce00 x1874407346695808/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574279.873994:0:8609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8609:1874407346695808:0@lo:5: 00000004:00080000:3.0:1787574279.874007:0:8609:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1787574279.874058:0:8609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8609:1874407346695936:0@lo:900: 00000100:00100000:3.0:1787574279.874092:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574279.874117:0:8609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574279.874149:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346695936 00000100:00100000:3.0:1787574279.874156:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346695936 00000100:00100000:3.0:1787574279.874194:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574279.874203:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8609:x1874407346695936:12345-0@lo:900: 00000100:00100000:3.0:1787574279.874278:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8609:x1874407346695936:12345-0@lo:900: Request processed in 76us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574279.874286:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787574279.874317:0:8609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8ca80 x1874407346695936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787574295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574279.874339:0:8609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8609:1874407346695936:0@lo:900: 00000100:00100000:1.0:1787574279.877406:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8616:x1874407346695296:12345-0@lo:5: Request processed in 92109us (96382us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787574279.877423:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787574279.877503:0:8616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca50459a680 x1874407346695296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574279.877516:0:8616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787574279.877522:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8616:1874407346695296:0@lo:5: 00000004:00080000:1.0:1787574279.877536:0:8616:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787574279.877579:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8616:1874407346696064:0@lo:700: 00000100:00100000:1.0:1787574279.877612:0:8616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574279.877646:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53be97d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574279.878103:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346696064 00000100:00100000:2.0:1787574279.878111:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346696064 00000100:00100000:2.0:1787574279.878429:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787574279.878440:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8616:x1874407346696064:12345-0@lo:700: 00000001:00080000:2.0:1787574279.899447:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:3.0:1787574279.901320:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8616:x1874407346696064:12345-0@lo:700: Request processed in 22873us (23698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574279.901339:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787574279.901675:0:8616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca50459a680 x1874407346696064/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787574295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574279.901689:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8616:1874407346696064:0@lo:700: 00000004:02000040:0.0:1787574279.915799:0:8616:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1787574279.927094:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8616:1874407346696192:0@lo:5: 00000100:00100000:1.0:1787574279.927181:0:8616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574279.927261:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53be97d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574279.927333:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346696192 00000100:00100000:3.0:1787574279.927340:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346696192 00000100:00100000:3.0:1787574279.927385:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574279.927394:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8616:x1874407346696192:12345-0@lo:5: 00002000:00080000:3.0:1787574279.930653:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787574279.930672:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1787574279.956542:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8616:x1874407346696192:12345-0@lo:5: Request processed in 29141us (29354us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787574279.956555:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787574279.956823:0:8616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca50459a680 x1874407346696192/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574279.956863:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8616:1874407346696192:0@lo:5: 00000004:00080000:0.0:1787574279.956880:0:8616:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1787574280.881586:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574281.460108:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346696320:0@lo:41: 00000100:00100000:0.0:1787574281.460175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574281.460211:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346696320 00000100:00100000:2.0:1787574281.460219:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346696320 00000100:00100000:2.0:1787574281.460283:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787574281.460292:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346696320:12345-0@lo:41: 00000004:00000024:2.0:1787574281.460324:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787574281.460370:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346696320:12345-0@lo:41: Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574281.460623:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787574281.460655:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346696320:0@lo:41: 00010000:00010000:3.0:1787574281.906028:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574281.973700:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346696448:0@lo:41: 00000100:00100000:0.0:1787574281.973782:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574281.973910:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346696448 00000100:00100000:3.0:1787574281.973920:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346696448 00000100:00100000:3.0:1787574281.973979:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787574281.974157:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346696448:12345-0@lo:41: 00000004:00000024:3.0:1787574281.974199:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787574281.976335:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346696448:12345-0@lo:41: Request processed in 2337us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574281.976345:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346696448:0@lo:41: 00000100:00100000:3.0:1787574281.976350:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1787574282.934194:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787574283.148027:0:8801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787574283.953921:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787574284.115041:0:8853:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787574284.115506:0:8853:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574284.987968:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574285.046493:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346696576:0@lo:13: 00000100:00100000:3.0:1787574285.046563:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574285.046650:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346696576 00000100:00100000:3.0:1787574285.046657:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346696576 00000100:00100000:3.0:1787574285.046708:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574285.046733:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346696576:12345-0@lo:13: 00002000:00000024:3.0:1787574285.046762:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574285.046806:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346696576:12345-0@lo:13: Request processed in 76us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574285.046813:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787574285.046834:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787574285.046862:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8ca80 x1874407346696576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574285.046872:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787574285.046913:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346696576:0@lo:13: 00000100:00100000:2.0:1787574285.052383:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346696704:0@lo:400: 00000100:00100000:2.0:1787574285.052457:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574285.052494:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346697216:0@lo:400: 00000100:00100000:2.0:1787574285.052520:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574285.052545:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787574285.052550:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346696832:0@lo:400: 00000100:00100000:2.0:1787574285.052574:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574285.052591:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346697344:0@lo:400: 00000100:00100000:2.0:1787574285.052609:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574285.052637:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346696960:0@lo:400: 00000100:00100000:2.0:1787574285.052659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574285.052676:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346697472:0@lo:400: 00000100:00100000:2.0:1787574285.052719:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574285.052735:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787574285.052746:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346697088:0@lo:400: 00000100:00100000:2.0:1787574285.052767:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574285.052784:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346697600:0@lo:400: 00000100:00100000:2.0:1787574285.052815:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574285.052853:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346696704 00000100:00100000:2.0:1787574285.052860:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346696704 00000100:00100000:2.0:1787574285.052919:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787574285.052929:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3634:x1874407346696704:12345-0@lo:400: 00000100:00100000:2.0:1787574285.052972:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3634:x1874407346696704:12345-0@lo:400: Request processed in 45us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574285.052990:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787574285.053021:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346697216 00000100:00100000:2.0:1787574285.053025:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346697216 00000100:00100000:2.0:1787574285.053040:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346696960 00000100:00100000:2.0:1787574285.053042:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346696960 00000100:00100000:2.0:1787574285.053053:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574285.053059:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346697216:12345-0@lo:400: 00000100:00100000:2.0:1787574285.053091:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346697216:12345-0@lo:400: Request processed in 32us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574285.053097:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574285.053108:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574285.053113:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346696960:12345-0@lo:400: 00000100:00100000:2.0:1787574285.053140:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346696960:12345-0@lo:400: Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574285.053145:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574285.053160:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346696832 00000100:00100000:2.0:1787574285.053164:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346696832 00000100:00100000:2.0:1787574285.053186:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346697344 00000100:00100000:2.0:1787574285.053189:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346697344 00000100:00100000:2.0:1787574285.053209:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346697472 00000100:00100000:2.0:1787574285.053211:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346697472 00000100:00100000:2.0:1787574285.053224:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346697088 00000100:00100000:2.0:1787574285.053226:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346697088 00000100:00100000:2.0:1787574285.053256:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574285.053263:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346696832:12345-0@lo:400: 00000100:00100000:2.0:1787574285.053292:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346696832:12345-0@lo:400: Request processed in 30us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574285.053298:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574285.053309:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574285.053315:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346697344:12345-0@lo:400: 00000100:00100000:2.0:1787574285.053339:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346697344:12345-0@lo:400: Request processed in 25us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574285.053344:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574285.053355:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787574285.053361:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346697472:12345-0@lo:400: 00000100:00100000:2.0:1787574285.053384:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346697472:12345-0@lo:400: Request processed in 24us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574285.053390:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787574285.053400:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787574285.053406:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346697088:12345-0@lo:400: 00000100:00100000:2.0:1787574285.053429:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346697088:12345-0@lo:400: Request processed in 24us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574285.053434:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787574285.053464:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574285.053468:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787574285.053499:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf4b800 x1874407346697088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574285.053512:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346697088:0@lo:400: 00000100:00100000:2.0:1787574285.053521:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346696960:0@lo:400: 00010000:00080000:2.0:1787574285.053529:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf48700 x1874407346697472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574285.053537:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346697472:0@lo:400: 00010000:00080000:2.0:1787574285.053563:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf4a300 x1874407346696832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574285.053570:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346696832:0@lo:400: 00010000:00080000:2.0:1787574285.053578:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf48380 x1874407346697344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574285.053584:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346697344:0@lo:400: 00000100:00100000:2.0:1787574285.053592:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346696704:0@lo:400: 00000100:00100000:2.0:1787574285.053599:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346697216:0@lo:400: 00000100:00100000:2.0:1787574285.054535:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346697600 00000100:00100000:2.0:1787574285.054544:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346697600 00000100:00100000:2.0:1787574285.054590:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574285.054597:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346697600:12345-0@lo:400: 00000100:00100000:2.0:1787574285.054649:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346697600:12345-0@lo:400: Request processed in 53us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574285.054655:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787574285.054674:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574285.054707:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf4aa00 x1874407346697600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574285.054718:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346697600:0@lo:400: 00000100:00100000:0.0:1787574285.056275:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574285.056291:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346697728:0@lo:13: 00000100:00100000:0.0:1787574285.056343:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574285.056382:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346697728 00000100:00100000:0.0:1787574285.056387:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346697728 00000100:00100000:0.0:1787574285.056423:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574285.056429:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346697728:12345-0@lo:13: 00002000:00000024:0.0:1787574285.056445:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574285.056481:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346697728:12345-0@lo:13: Request processed in 52us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574285.056486:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787574285.056518:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019eca80 x1874407346697728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574285.056552:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346697728:0@lo:13: 00000001:00080000:0.0:1787574285.543743:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1787574286.005176:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574286.581044:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346697856:0@lo:41: 00000100:00100000:1.0:1787574286.581124:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574286.581203:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346697856 00000100:00100000:1.0:1787574286.581210:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346697856 00000100:00100000:1.0:1787574286.581278:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787574286.581288:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346697856:12345-0@lo:41: 00000004:00000024:1.0:1787574286.581343:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787574286.581392:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346697856:12345-0@lo:41: Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574286.581400:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787574286.581450:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346697856:0@lo:41: 00010000:00010000:3.0:1787574287.028676:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574287.095531:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574287.095553:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346697984:0@lo:41: 00000100:00100000:2.0:1787574287.095633:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574287.095695:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346697984 00000100:00100000:2.0:1787574287.095703:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346697984 00000100:00100000:2.0:1787574287.095744:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574287.095753:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346697984:12345-0@lo:41: 00000004:00000024:2.0:1787574287.095787:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787574287.095828:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346697984:12345-0@lo:41: Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574287.095835:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574287.095882:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346697984:0@lo:41: 00000020:00000004:2.0:1787574287.881196:0:8955:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787574287.882594:0:8955:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787574288.051429:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574289.077162:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787574289.251789:0:9003:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787574289.251811:0:9003:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1787574290.097516:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574290.161546:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346698112:0@lo:13: 00000100:00100000:2.0:1787574290.161642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574290.161810:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346698112 00000100:00100000:0.0:1787574290.161818:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346698112 00000100:00100000:0.0:1787574290.161890:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574290.161903:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346698112:12345-0@lo:13: 00002000:00000024:0.0:1787574290.161942:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574290.161987:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346698112:12345-0@lo:13: Request processed in 87us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574290.161994:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787574290.162127:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574290.162156:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019edc00 x1874407346698112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574290.162166:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787574290.162186:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346698112:0@lo:13: 00000100:00100000:3.0:1787574290.162388:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346698368:0@lo:400: 00000100:00100000:3.0:1787574290.162420:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574290.162438:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346698880:0@lo:400: 00000100:00100000:3.0:1787574290.162462:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574290.162478:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787574290.162484:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346698240:0@lo:400: 00000100:00100000:3.0:1787574290.162509:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574290.162528:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346698752:0@lo:400: 00000100:00100000:0.0:1787574290.162622:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346698240 00000100:00100000:0.0:1787574290.162637:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346698240 00000100:00100000:0.0:1787574290.162665:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787574290.162672:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3635:x1874407346698240:12345-0@lo:400: 00000100:00100000:0.0:1787574290.162703:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3635:x1874407346698240:12345-0@lo:400: Request processed in 31us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574290.162708:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787574290.162833:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574290.162957:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346698496:0@lo:400: 00000100:00100000:3.0:1787574290.163142:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346698240:0@lo:400: 00000100:00100000:2.0:1787574290.163268:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346698368 00000100:00100000:2.0:1787574290.163272:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346698368 00000100:00100000:2.0:1787574290.163302:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346698880 00000100:00100000:2.0:1787574290.163306:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346698880 00000100:00100000:2.0:1787574290.163330:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787574290.163336:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346698368:12345-0@lo:400: 00000100:00100000:2.0:1787574290.163372:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346698368:12345-0@lo:400: Request processed in 36us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574290.163378:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787574290.163391:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787574290.163397:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346698880:12345-0@lo:400: 00000100:00100000:2.0:1787574290.163422:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346698880:12345-0@lo:400: Request processed in 26us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574290.163428:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787574290.163453:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574290.163465:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346698624:0@lo:400: 00000100:00100000:2.0:1787574290.163490:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574290.163507:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346699136:0@lo:400: 00000100:00100000:2.0:1787574290.163527:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574290.163569:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346698624 00000100:00100000:2.0:1787574290.163572:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346698624 00000100:00100000:2.0:1787574290.163592:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787574290.163597:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346698624:12345-0@lo:400: 00000100:00100000:2.0:1787574290.163753:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346698624:12345-0@lo:400: Request processed in 29us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574290.163762:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787574290.163791:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8e680 x1874407346698624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574290.163815:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346698624:0@lo:400: 00000100:00100000:2.0:1787574290.163849:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346699136 00000100:00100000:2.0:1787574290.163852:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346699136 00000100:00100000:2.0:1787574290.163882:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787574290.163889:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346699136:12345-0@lo:400: 00000100:00100000:2.0:1787574290.163922:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346699136:12345-0@lo:400: Request processed in 34us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574290.163927:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787574290.163957:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574290.163971:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8df80 x1874407346699136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574290.163980:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346699136:0@lo:400: 00000100:00100000:1.0:1787574290.164269:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574290.164318:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346699264:0@lo:13: 00000100:00100000:3.0:1787574290.164348:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787574290.164402:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8ce00 x1874407346698368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574290.164424:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346698368:0@lo:400: 00010000:00080000:3.0:1787574290.164437:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8c700 x1874407346698880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574290.164444:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346698880:0@lo:400: 00000100:00100000:2.0:1787574290.167412:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346699264 00000100:00100000:2.0:1787574290.167426:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346699264 00000100:00100000:2.0:1787574290.167504:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574290.167515:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346699264:12345-0@lo:13: 00002000:00000024:2.0:1787574290.167551:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574290.167652:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346699264:12345-0@lo:13: Request processed in 139us (3302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574290.167659:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787574290.168023:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf48a80 x1874407346699264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574290.168045:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346699264:0@lo:13: 00000100:00100000:0.0:1787574290.172426:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346698752 00000100:00100000:0.0:1787574290.172444:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346698752 00000100:00100000:0.0:1787574290.172500:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346698496 00000100:00100000:0.0:1787574290.172504:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346698496 00000100:00100000:0.0:1787574290.172523:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787574290.172532:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346698752:12345-0@lo:400: 00000100:00100000:0.0:1787574290.172651:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346698752:12345-0@lo:400: Request processed in 120us (9817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574290.172677:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787574290.172694:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574290.172700:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346698496:12345-0@lo:400: 00000100:00100000:0.0:1787574290.172731:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346698496:12345-0@lo:400: Request processed in 31us (8462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574290.172737:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787574290.172750:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346698752:0@lo:400: 00000100:00100000:1.0:1787574290.172807:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346698496:0@lo:400: 00000100:00100000:1.0:1787574290.172819:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346699008:0@lo:400: 00000100:00100000:1.0:1787574290.172871:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574290.173088:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346699008 00000100:00100000:3.0:1787574290.173093:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346699008 00000100:00100000:3.0:1787574290.173149:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787574290.173157:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346699008:12345-0@lo:400: 00000100:00100000:3.0:1787574290.173194:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346699008:12345-0@lo:400: Request processed in 39us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574290.173199:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787574290.174296:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787574290.174412:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8ea00 x1874407346699008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574290.174428:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346699008:0@lo:400: 00010000:00010000:1.0:1787574291.123189:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574291.701014:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574291.701049:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346699392:0@lo:41: 00000100:00100000:0.0:1787574291.701124:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574291.701192:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346699392 00000100:00100000:0.0:1787574291.701201:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346699392 00000100:00100000:0.0:1787574291.701270:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574291.701280:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346699392:12345-0@lo:41: 00000004:00000024:0.0:1787574291.701311:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787574291.701355:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346699392:12345-0@lo:41: Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574291.701363:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574291.701408:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346699392:0@lo:41: 00010000:00010000:3.0:1787574292.146523:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574292.210177:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574292.210206:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346699520:0@lo:41: 00000100:00100000:3.0:1787574292.210310:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574292.210427:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346699520 00000100:00100000:0.0:1787574292.210434:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346699520 00000100:00100000:0.0:1787574292.210483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787574292.210491:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346699520:12345-0@lo:41: 00000004:00000024:0.0:1787574292.210523:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787574292.210571:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346699520:12345-0@lo:41: Request processed in 81us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574292.210593:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787574292.210681:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346699520:0@lo:41: 00010000:00010000:1.0:1787574293.169635:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574294.215158:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574295.217425:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574295.283645:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346699648:0@lo:13: 00000100:00100000:2.0:1787574295.283716:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574295.283823:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346699648 00000100:00100000:0.0:1787574295.283832:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346699648 00000100:00100000:0.0:1787574295.283901:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574295.283911:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346699648:12345-0@lo:13: 00002000:00000024:0.0:1787574295.283939:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574295.283984:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346699648:12345-0@lo:13: Request processed in 75us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574295.283991:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787574295.284043:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574295.284072:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019ed880 x1874407346699648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574295.284107:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346699648:0@lo:13: 00000100:00100000:0.0:1787574295.287330:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346699904:0@lo:400: 00000100:00100000:0.0:1787574295.287397:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574295.287427:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346700416:0@lo:400: 00000100:00100000:0.0:1787574295.287449:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574295.287472:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787574295.287477:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346699776:0@lo:400: 00000100:00100000:0.0:1787574295.287501:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574295.287524:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346700288:0@lo:400: 00000100:00100000:0.0:1787574295.287546:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574295.287573:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346700288 00000100:00100000:0.0:1787574295.287579:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346700288 00000100:00100000:0.0:1787574295.287622:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574295.287631:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346700288:12345-0@lo:400: 00000100:00100000:0.0:1787574295.287680:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346700288:12345-0@lo:400: Request processed in 50us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574295.287687:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574295.287708:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346700032:0@lo:400: 00000100:00100000:0.0:1787574295.287743:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574295.287759:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346700544:0@lo:400: 00000100:00100000:0.0:1787574295.287778:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574295.287795:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787574295.287800:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346700160:0@lo:400: 00000100:00100000:0.0:1787574295.287840:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574295.287859:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346700672:0@lo:400: 00000100:00100000:0.0:1787574295.287903:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574295.287932:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346699904 00000100:00100000:0.0:1787574295.287935:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346699904 00000100:00100000:0.0:1787574295.287956:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346700416 00000100:00100000:0.0:1787574295.287958:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346700416 00000100:00100000:0.0:1787574295.287979:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346700544 00000100:00100000:0.0:1787574295.287983:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346700544 00000100:00100000:0.0:1787574295.287993:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346700160 00000100:00100000:0.0:1787574295.287996:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346700160 00000100:00100000:0.0:1787574295.288008:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574295.288013:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346699904:12345-0@lo:400: 00000100:00100000:0.0:1787574295.288056:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346699904:12345-0@lo:400: Request processed in 33us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574295.288062:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574295.288073:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574295.288079:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346700416:12345-0@lo:400: 00000100:00100000:0.0:1787574295.288103:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346700416:12345-0@lo:400: Request processed in 25us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574295.288108:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574295.288119:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574295.288124:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346700544:12345-0@lo:400: 00000100:00100000:0.0:1787574295.288174:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346700544:12345-0@lo:400: Request processed in 49us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574295.288180:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574295.288191:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787574295.288197:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346700160:12345-0@lo:400: 00000100:00100000:0.0:1787574295.288224:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346700160:12345-0@lo:400: Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574295.288229:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787574295.288265:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346700032 00000100:00100000:0.0:1787574295.288268:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346700032 00000100:00100000:0.0:1787574295.288287:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787574295.288291:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346700032:12345-0@lo:400: 00000100:00100000:0.0:1787574295.288318:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346700032:12345-0@lo:400: Request processed in 27us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574295.288324:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787574295.288354:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019eca80 x1874407346700160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574295.288368:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346700160:0@lo:400: 00000100:00100000:0.0:1787574295.288379:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346700032:0@lo:400: 00010000:00080000:0.0:1787574295.288388:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019eed80 x1874407346700544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574295.288395:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346700544:0@lo:400: 00000100:00100000:0.0:1787574295.288422:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346700288:0@lo:400: 00010000:00080000:0.0:1787574295.288432:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019ed880 x1874407346699904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574295.288448:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346699904:0@lo:400: 00010000:00080000:0.0:1787574295.288458:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019efb80 x1874407346700416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574295.288466:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346700416:0@lo:400: 00000100:00100000:2.0:1787574295.290261:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346699776 00000100:00100000:2.0:1787574295.290270:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346699776 00000100:00100000:2.0:1787574295.290308:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787574295.290316:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3635:x1874407346699776:12345-0@lo:400: 00000100:00100000:2.0:1787574295.290390:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3635:x1874407346699776:12345-0@lo:400: Request processed in 75us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574295.290396:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787574295.290429:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346700672 00000100:00100000:2.0:1787574295.290433:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346700672 00000100:00100000:2.0:1787574295.290460:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574295.290465:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346700672:12345-0@lo:400: 00000100:00100000:2.0:1787574295.290494:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346700672:12345-0@lo:400: Request processed in 29us (2592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574295.290499:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787574295.290514:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574295.290518:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574295.290520:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574295.290610:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346700800:0@lo:13: 00000100:00100000:1.0:1787574295.290646:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574295.290989:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346700800 00000100:00100000:0.0:1787574295.290994:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346700800 00000100:00100000:0.0:1787574295.291019:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574295.291026:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346700800:12345-0@lo:13: 00002000:00000024:0.0:1787574295.291040:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574295.291808:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346700800:12345-0@lo:13: Request processed in 779us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574295.291816:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787574295.291860:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5350e7b80 x1874407346700672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574295.291873:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346700672:0@lo:400: 00000100:00100000:0.0:1787574295.291917:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346699776:0@lo:400: 00010000:00080000:1.0:1787574295.301279:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf4b800 x1874407346700800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574295.301308:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346700800:0@lo:13: 00010000:00010000:3.0:1787574296.244287:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574296.819546:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346700928:0@lo:41: 00000100:00100000:1.0:1787574296.819621:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574296.819910:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346700928 00000100:00100000:0.0:1787574296.819919:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346700928 00000100:00100000:0.0:1787574296.819978:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787574296.819988:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346700928:12345-0@lo:41: 00000004:00000024:0.0:1787574296.820024:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787574296.820087:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346700928:12345-0@lo:41: Request processed in 99us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574296.820093:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787574296.820185:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346700928:0@lo:41: 00010000:00010000:3.0:1787574297.267020:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574297.331214:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346701056:0@lo:41: 00000100:00100000:0.0:1787574297.331320:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574297.332669:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346701056 00000100:00100000:2.0:1787574297.332680:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346701056 00000100:00100000:2.0:1787574297.332747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574297.332758:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346701056:12345-0@lo:41: 00000004:00000024:2.0:1787574297.332809:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787574297.332891:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346701056:12345-0@lo:41: Request processed in 134us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574297.332898:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574297.333087:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346701056:0@lo:41: 00010000:00010000:3.0:1787574298.289879:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574299.316529:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574300.337446:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574300.406438:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346701184:0@lo:13: 00000100:00100000:3.0:1787574300.406515:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574300.406583:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346701184 00000100:00100000:3.0:1787574300.406589:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346701184 00000100:00100000:3.0:1787574300.406632:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574300.406640:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346701184:12345-0@lo:13: 00002000:00000024:3.0:1787574300.406669:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574300.406708:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346701184:12345-0@lo:13: Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574300.406715:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787574300.406734:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787574300.406760:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5350e5f80 x1874407346701184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574300.406778:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346701184:0@lo:13: 00000100:00100000:2.0:1787574300.407021:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574300.407031:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346701312:0@lo:13: 00000100:00100000:2.0:1787574300.407069:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574300.407096:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346701312 00000100:00100000:2.0:1787574300.407099:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346701312 00000100:00100000:2.0:1787574300.407123:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574300.407129:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346701312:12345-0@lo:13: 00002000:00000024:2.0:1787574300.407138:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574300.407162:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346701312:12345-0@lo:13: Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574300.407168:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787574300.407180:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574300.407193:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf48700 x1874407346701312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574300.407204:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346701312:0@lo:13: 00000100:00100000:2.0:1787574300.416219:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346701568:0@lo:400: 00000100:00100000:2.0:1787574300.416316:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574300.416346:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346702080:0@lo:400: 00000100:00100000:2.0:1787574300.416368:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574300.416390:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787574300.416396:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346701696:0@lo:400: 00000100:00100000:2.0:1787574300.416420:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574300.416436:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346702208:0@lo:400: 00000100:00100000:2.0:1787574300.416455:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574300.416495:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346701696 00000100:00100000:2.0:1787574300.416503:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346701696 00000100:00100000:2.0:1787574300.416548:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787574300.416565:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346701696:12345-0@lo:400: 00000100:00100000:2.0:1787574300.416620:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346701696:12345-0@lo:400: Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574300.416628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787574300.416651:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346701568 00000100:00100000:2.0:1787574300.416655:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346701568 00000100:00100000:2.0:1787574300.416676:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346702080 00000100:00100000:2.0:1787574300.416679:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346702080 00000100:00100000:2.0:1787574300.416702:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346702208 00000100:00100000:2.0:1787574300.416705:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346702208 00000100:00100000:2.0:1787574300.416719:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574300.416725:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346701568:12345-0@lo:400: 00000100:00100000:2.0:1787574300.416754:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346701568:12345-0@lo:400: Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574300.416773:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574300.416785:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574300.416791:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346702080:12345-0@lo:400: 00000100:00100000:2.0:1787574300.416817:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346702080:12345-0@lo:400: Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574300.416822:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574300.416833:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574300.416849:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346702208:12345-0@lo:400: 00000100:00100000:2.0:1787574300.416876:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346702208:12345-0@lo:400: Request processed in 37us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574300.416881:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787574300.416908:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574300.416912:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574300.416943:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346701696:0@lo:400: 00010000:00080000:2.0:1787574300.416965:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5349ff100 x1874407346702208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574300.416975:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346702208:0@lo:400: 00010000:00080000:2.0:1787574300.416984:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf4b800 x1874407346701568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574300.416992:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346701568:0@lo:400: 00010000:00080000:2.0:1787574300.417001:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5349ffb80 x1874407346702080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574300.417008:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346702080:0@lo:400: 00000100:00100000:3.0:1787574300.417186:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346701440:0@lo:400: 00000100:00100000:3.0:1787574300.417226:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574300.417273:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346701952:0@lo:400: 00000100:00100000:3.0:1787574300.417296:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574300.417315:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574300.417321:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346701824:0@lo:400: 00000100:00100000:3.0:1787574300.417344:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574300.417366:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346701952 00000100:00100000:3.0:1787574300.417376:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346701952 00000100:00100000:3.0:1787574300.417397:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574300.417403:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346701952:12345-0@lo:400: 00000100:00100000:3.0:1787574300.417440:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346701952:12345-0@lo:400: Request processed in 37us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574300.417445:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574300.417468:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346701824 00000100:00100000:3.0:1787574300.417472:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346701824 00000100:00100000:3.0:1787574300.417507:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574300.417513:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346701824:12345-0@lo:400: 00000100:00100000:3.0:1787574300.417541:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346701824:12345-0@lo:400: Request processed in 29us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574300.417547:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787574300.417573:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5045a8380 x1874407346701824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574300.417583:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346701824:0@lo:400: 00000100:00100000:3.0:1787574300.417592:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346701952:0@lo:400: 00000100:00100000:2.0:1787574300.419551:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346701440 00000100:00100000:2.0:1787574300.419561:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346701440 00000100:00100000:2.0:1787574300.419610:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787574300.419620:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3635:x1874407346701440:12345-0@lo:400: 00000100:00100000:2.0:1787574300.419690:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3635:x1874407346701440:12345-0@lo:400: Request processed in 72us (2464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574300.419697:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787574300.423194:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346701440:0@lo:400: 00010000:00010000:3.0:1787574301.361974:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574301.940117:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346702336:0@lo:41: 00000100:00100000:0.0:1787574301.940222:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574301.940424:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346702336 00000100:00100000:0.0:1787574301.940436:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346702336 00000100:00100000:0.0:1787574301.942069:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787574301.942093:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346702336:12345-0@lo:41: 00000004:00000024:0.0:1787574301.942151:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787574301.942277:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346702336:12345-0@lo:41: Request processed in 192us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574301.942285:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787574301.942402:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346702336:0@lo:41: 00010000:00010000:2.0:1787574302.385502:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574302.449637:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574302.449690:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346702464:0@lo:41: 00000100:00100000:2.0:1787574302.450181:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574302.450366:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346702464 00000100:00100000:0.0:1787574302.450378:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346702464 00000100:00100000:0.0:1787574302.450440:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787574302.450451:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346702464:12345-0@lo:41: 00000004:00000024:0.0:1787574302.450508:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787574302.450560:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346702464:12345-0@lo:41: Request processed in 111us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574302.450568:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787574302.454574:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346702464:0@lo:41: 00010000:00010000:0.0:1787574303.417120:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574304.433700:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787574305.175406:0:9503:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787574305.175410:0:9503:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787574305.175411:0:9503:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787574305.175562:0:9503:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ca53bf11000 00000020:01000004:3.0:1787574305.175587:0:9503:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787574305.175601:0:9503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787574305.175622:0:9503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ca4024cb370) 00000020:00000080:3.0:1787574305.175640:0:9503:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787574305.247100:0:9503:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787574305.247155:0:9503:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1787574305.280787:0:9503:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787574305.281012:0:9503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787574305.281031:0:9503:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787574305.281041:0:9503:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd18a1efeeddb7d53 00000020:01000004:3.0:1787574305.281048:0:9503:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787574305.281070:0:9503:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787574305.281073:0:9503:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787574305.281080:0:9503:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787574305.281106:0:9503:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787574305.281110:0:9503:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787574305.299983:0:9503:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787574305.300020:0:9503:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787574305.300025:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787574305.300027:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787574305.300028:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574305.300029:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574305.300031:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574305.300032:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574305.300033:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574305.300035:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574305.300036:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574305.300038:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574305.300039:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574305.300043:0:9503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787574305.300045:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574305.300047:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787574305.300048:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574305.300049:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574305.300050:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574305.300051:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574305.300052:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574305.300053:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574305.300054:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574305.300055:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574305.300056:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574305.300087:0:9503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787574305.300104:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346702592:0@lo:253: 00000100:00100000:2.0:1787574305.300516:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574305.300627:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53b09c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574305.300705:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346702592 00000100:00100000:0.0:1787574305.300782:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346702592 00000100:00100000:0.0:1787574305.301150:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787574305.301161:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:9503:x1874407346702592:12345-0@lo:253: 20000000:01000000:0.0:1787574305.301192:0:6501:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787574305.301204:0:6501:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787574305.301209:0:6501:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787574305.301212:0:6501:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787574305.301473:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574305.301591:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1787574305.301605:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787574305.301621:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1787574305.301626:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787574305.301639:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1787574305.301652:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1787574305.301744:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1787574305.301760:0:6501:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:0.0:1787574305.301762:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:0.0:1787574305.301775:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1787574305.301781:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787574305.301794:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1787574305.301811:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:0.0:1787574305.301826:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1787574305.301833:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787574305.301845:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1787574305.301862:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1787574305.301928:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1787574305.301939:0:6501:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:0.0:1787574305.301940:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:0.0:1787574305.301954:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1787574305.301959:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787574305.301972:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1787574305.301977:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:0.0:1787574305.301990:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1787574305.301996:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787574305.302007:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1787574305.302029:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1787574305.302435:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1787574305.302446:0:6501:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:0.0:1787574305.302448:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:0.0:1787574305.302477:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1787574305.302483:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787574305.302493:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1787574305.302498:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:0.0:1787574305.302511:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1787574305.302517:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787574305.302529:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1787574305.302545:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1787574305.302557:0:6501:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787574305.302560:0:6501:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787574305.302564:0:6501:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787574305.302604:0:6501:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787574305.302607:0:6501:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787574305.303973:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1787574305.304002:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1787574305.304016:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1787574305.304214:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1787574305.304489:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1787574305.304505:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1787574305.304515:0:6501:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787574305.304517:0:6501:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787574305.304785:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1787574305.304814:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1787574305.304832:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1787574305.304970:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1787574305.304987:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1787574305.305007:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1787574305.305017:0:6501:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787574305.305019:0:6501:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787574305.305473:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1787574305.305609:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1787574305.305628:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1787574305.305643:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1787574305.305651:0:6501:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787574305.305653:0:6501:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787574305.305891:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1787574305.305908:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1787574305.305920:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1787574305.306042:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1787574305.306058:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1787574305.306071:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1787574305.306078:0:6501:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787574305.306079:0:6501:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787574305.306535:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1787574305.306561:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1787574305.306571:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787574305.306706:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787574305.306725:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1787574305.306738:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:2.0:1787574305.306752:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787574305.306770:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.306787:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be74400/0xd18a1efeeddb7c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c49 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.306886:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c73 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.306897:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb7cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cb2 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.306904:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cce expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.306911:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb7cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cf8 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.306928:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be99e00/0xd18a1efeeddb7d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d14 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.306935:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca535c11a00/0xd18a1efeeddb7d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d37 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.306943:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.306979:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca535c11a00/0xd18a1efeeddb7d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7d37 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.306995:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca535c11a00/0xd18a1efeeddb7d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d37 expref: 21 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.307009:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346702720:0@lo:104: 00000100:00100000:2.0:1787574305.307066:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574305.307161:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be99e00/0xd18a1efeeddb7d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7d14 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.307170:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be99e00/0xd18a1efeeddb7d1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d14 expref: 21 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.307178:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346702848:0@lo:104: 00000100:00100000:2.0:1787574305.307197:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574305.307579:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb7cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7cf8 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.307588:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb7cff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cf8 expref: 21 pid: 6504 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.307604:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346702976:0@lo:104: 00000100:00100000:2.0:1787574305.307639:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574305.307656:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346702720 00000100:00100000:1.0:1787574305.307662:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346702720 00000100:00100000:0.0:1787574305.307705:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346702848 00000100:00100000:0.0:1787574305.307708:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346702848 00000100:00100000:0.0:1787574305.307737:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787574305.307745:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6501:x1874407346702720:12345-0@lo:104: 00010000:00010000:0.0:1787574305.307757:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.307816:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574305.307822:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6501:x1874407346702720:12345-0@lo:104: Request processed in 78us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.307829:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787574305.307848:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787574305.307854:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6501:x1874407346702848:12345-0@lo:104: 00010000:00010000:0.0:1787574305.307862:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.307894:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787574305.307899:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6501:x1874407346702848:12345-0@lo:104: Request processed in 46us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.307905:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787574305.307922:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574305.307927:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.307935:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10800 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574305.307939:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.307948:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574305.307965:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574305.307971:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574305.307997:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308003:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574305.308018:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308026:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c10800/0xd18a1efeeddb7d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d3e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308037:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574305.308039:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308045:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574305.308048:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308055:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574305.308061:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574305.308066:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574305.308082:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308087:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574305.308092:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308098:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c10200/0xd18a1efeeddb7d14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d1b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308106:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574305.308107:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574305.308109:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574305.308128:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346703104:0@lo:103: 00000100:00100000:0.0:1787574305.308152:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.308172:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574305.308177:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346703232:0@lo:103: 00000100:00100000:0.0:1787574305.308194:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.308218:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346703104 00010000:00010000:3.0:1787574305.308364:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574305.308416:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346703104 00010000:00010000:0.0:1787574305.308434:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca535c11a00/0xd18a1efeeddb7d3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d37 expref: 22 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574305.308451:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346703232 00000100:00100000:0.0:1787574305.308454:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346703232 00010000:00010000:0.0:1787574305.308463:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be99e00/0xd18a1efeeddb7d1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d14 expref: 23 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574305.308478:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787574305.308484:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:3636:x1874407346703104:12345-0@lo:103: 00010000:00010000:0.0:1787574305.308500:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574305.308506:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca535c11a00/0xd18a1efeeddb7d3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d37 expref: 23 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308516:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca535c11a00/0xd18a1efeeddb7d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d37 expref: 23 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308529:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574305.308555:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:3636:x1874407346703104:12345-0@lo:103: Request processed in 71us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.308562:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787574305.308574:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787574305.308581:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3636:x1874407346703232:12345-0@lo:103: 00010000:00010000:0.0:1787574305.308587:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574305.308592:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be99e00/0xd18a1efeeddb7d1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d14 expref: 22 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308599:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be99e00/0xd18a1efeeddb7d1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d14 expref: 22 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.308608:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574305.308628:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3636:x1874407346703232:12345-0@lo:103: Request processed in 48us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.308634:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787574305.308667:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346703232:0@lo:103: 00000100:00100000:0.0:1787574305.308675:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346703104:0@lo:103: 00010000:00010000:2.0:1787574305.308808:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7cce expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.308818:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cce expref: 21 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.308826:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346703360:0@lo:104: 00000100:00100000:2.0:1787574305.308849:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574305.308865:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb7cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7cb2 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.308874:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb7cb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cb2 expref: 21 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.308882:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346703488:0@lo:104: 00000100:00100000:2.0:1787574305.308899:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574305.308912:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7c73 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.308920:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c73 expref: 21 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.308928:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346703616:0@lo:104: 00000100:00100000:2.0:1787574305.308944:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574305.308957:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be74400/0xd18a1efeeddb7c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7c49 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.308976:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be74400/0xd18a1efeeddb7c50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c49 expref: 21 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.308984:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346703744:0@lo:104: 00000100:00100000:2.0:1787574305.309000:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53b09cd80 going to sleep for 11 seconds 00010000:00010000:2.0:1787574305.309010:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c11a00/0xd18a1efeeddb7d3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7d37 expref: 21 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.309020:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346702720:0@lo:104: 00010000:00010000:2.0:1787574305.309028:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be99e00/0xd18a1efeeddb7d1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7d14 expref: 20 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.309036:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346702848:0@lo:104: 00000100:00100000:0.0:1787574305.309085:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787574305.309100:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.309114:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346702976 00000100:00100000:0.0:1787574305.309117:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346702976 00000100:00100000:0.0:1787574305.309131:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346703360 00000100:00100000:0.0:1787574305.309134:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346703360 00000100:00100000:0.0:1787574305.309141:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346703488 00000100:00100000:0.0:1787574305.309143:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346703488 00000100:00100000:0.0:1787574305.309150:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346703616 00000100:00100000:0.0:1787574305.309152:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346703616 00000100:00100000:0.0:1787574305.309160:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346703744 00000100:00100000:0.0:1787574305.309162:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346703744 00000100:00100000:0.0:1787574305.309186:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787574305.309192:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+7:6501:x1874407346702976:12345-0@lo:104: 00010000:00010000:0.0:1787574305.309200:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.309636:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574305.309643:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+7:6501:x1874407346702976:12345-0@lo:104: Request processed in 451us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.309650:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787574305.309663:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787574305.309671:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+6:6501:x1874407346703360:12345-0@lo:104: 00010000:00010000:0.0:1787574305.309678:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.309707:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787574305.309711:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+6:6501:x1874407346703360:12345-0@lo:104: Request processed in 43us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.309717:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787574305.309727:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787574305.309733:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:6501:x1874407346703488:12345-0@lo:104: 00010000:00010000:0.0:1787574305.309745:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.309770:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787574305.309775:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:6501:x1874407346703488:12345-0@lo:104: Request processed in 43us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.309781:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787574305.309792:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787574305.309808:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402229c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6501:x1874407346703616:12345-0@lo:104: 00010000:00010000:0.0:1787574305.309815:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.309840:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787574305.309844:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402229c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6501:x1874407346703616:12345-0@lo:104: Request processed in 48us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.309850:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787574305.309874:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787574305.309879:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6501:x1874407346703744:12345-0@lo:104: 00010000:00010000:0.0:1787574305.309886:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.309910:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787574305.309915:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6501:x1874407346703744:12345-0@lo:104: Request processed in 37us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.309920:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787574305.309977:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787574305.309982:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.309990:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031e00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574305.309994:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310002:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574305.310010:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574305.310016:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574305.310045:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310051:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574305.310067:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310074:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb7cf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cff expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310090:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787574305.310094:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310099:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421faa00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574305.310103:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310110:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574305.310116:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574305.310120:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574305.310132:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310138:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574305.310143:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310149:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421faa00/0xd18a1efeeddb7cce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cd5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310158:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787574305.310161:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310175:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574305.310178:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310185:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574305.310191:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574305.310196:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574305.310206:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310212:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574305.310254:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310261:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa000/0xd18a1efeeddb7cb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310269:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574305.310272:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310278:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574305.310281:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310297:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574305.310303:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574305.310308:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574305.310333:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310339:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574305.310345:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310352:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb7c73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c7a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310361:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574305.310364:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310369:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be98c00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574305.310372:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310379:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574305.310385:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574305.310396:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574305.310408:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310414:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574305.310418:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310425:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7c49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c50 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310437:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574305.310438:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574305.310440:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574305.310452:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346703872:0@lo:103: 00000100:00100000:3.0:1787574305.310489:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.310516:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346704384:0@lo:103: 00000100:00100000:3.0:1787574305.310538:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.310556:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574305.310562:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346704000:0@lo:103: 00000100:00100000:3.0:1787574305.310581:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.310609:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346703872 00000100:00100000:3.0:1787574305.310615:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346703872 00010000:00010000:3.0:1787574305.310636:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb7cff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cf8 expref: 20 pid: 6504 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574305.310655:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346704384 00000100:00100000:3.0:1787574305.310658:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346704384 00010000:00010000:3.0:1787574305.310673:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be74400/0xd18a1efeeddb7c50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c49 expref: 21 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574305.310684:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346704000 00000100:00100000:3.0:1787574305.310686:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346704000 00010000:00010000:3.0:1787574305.310694:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cce expref: 22 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574305.310704:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787574305.310710:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3634:x1874407346703872:12345-0@lo:103: 00010000:00010000:3.0:1787574305.310719:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574305.310724:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb7cff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cf8 expref: 22 pid: 6504 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310733:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb7cff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cf8 expref: 22 pid: 6504 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310746:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574305.310772:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3634:x1874407346703872:12345-0@lo:103: Request processed in 62us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.310778:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787574305.310792:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574305.310809:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3634:x1874407346704384:12345-0@lo:103: 00010000:00010000:3.0:1787574305.310816:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574305.310820:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be74400/0xd18a1efeeddb7c50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c49 expref: 21 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310829:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be74400/0xd18a1efeeddb7c50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c49 expref: 21 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310848:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574305.310869:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3634:x1874407346704384:12345-0@lo:103: Request processed in 72us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.310875:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574305.310906:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574305.310911:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:3634:x1874407346704000:12345-0@lo:103: 00010000:00010000:3.0:1787574305.310917:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574305.310921:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cce expref: 20 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310930:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cce expref: 20 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.310939:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574305.310956:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:3634:x1874407346704000:12345-0@lo:103: Request processed in 45us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.310961:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574305.310978:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346704256:0@lo:103: 00000100:00100000:3.0:1787574305.310996:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.311010:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574305.311015:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346704128:0@lo:103: 00000100:00100000:3.0:1787574305.311030:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.311045:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346704256 00000100:00100000:3.0:1787574305.311048:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346704256 00010000:00010000:3.0:1787574305.311059:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c73 expref: 20 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574305.311070:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346704128 00000100:00100000:3.0:1787574305.311077:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346704128 00010000:00010000:3.0:1787574305.311087:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb7cb9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cb2 expref: 21 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574305.311098:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787574305.311103:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3637:x1874407346704256:12345-0@lo:103: 00010000:00010000:3.0:1787574305.311109:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574305.311113:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c73 expref: 21 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311121:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c73 expref: 21 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311130:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574305.311152:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3637:x1874407346704256:12345-0@lo:103: Request processed in 48us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.311157:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787574305.311167:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574305.311172:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:3637:x1874407346704128:12345-0@lo:103: 00010000:00010000:3.0:1787574305.311178:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574305.311182:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb7cb9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cb2 expref: 20 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311191:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb7cb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cb2 expref: 20 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311201:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311210:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311228:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311235:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311262:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311269:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311274:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574305.311278:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311285:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311293:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.311302:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574305.311325:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:3637:x1874407346704128:12345-0@lo:103: Request processed in 153us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.311331:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574305.311361:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346704128:0@lo:103: 00000100:00100000:3.0:1787574305.311370:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346704256:0@lo:103: 00000100:00100000:3.0:1787574305.311393:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346704000:0@lo:103: 00000100:00100000:3.0:1787574305.311408:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346703872:0@lo:103: 00000100:00100000:3.0:1787574305.311414:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346704384:0@lo:103: 00010000:00010000:3.0:1787574305.311428:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574305.311856:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb7cff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7cf8 expref: 19 pid: 6504 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.311869:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346702976:0@lo:104: 00010000:00010000:2.0:1787574305.311878:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb7cd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7cce expref: 18 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.311887:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346703360:0@lo:104: 00010000:00010000:2.0:1787574305.311895:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb7cb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7cb2 expref: 17 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.311903:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346703488:0@lo:104: 00010000:00010000:2.0:1787574305.311912:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500030a00/0xd18a1efeeddb7c7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7c73 expref: 16 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.311932:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346703616:0@lo:104: 00010000:00010000:2.0:1787574305.311942:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74400/0xd18a1efeeddb7c50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7c49 expref: 15 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.311950:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6501:1874407346703744:0@lo:104: 00010000:00010000:2.0:1787574305.311973:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.311981:0:6501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.311988:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.311994:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb7d5a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787574305.312006:0:6501:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787574305.314622:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:9503:x1874407346702592:12345-0@lo:253: Request processed in 13455us (14099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.314636:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787574305.314713:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346702592:0@lo:253: 10000000:01000000:0.0:1787574305.314728:0:9503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787574305.314741:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787574305.314743:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787574305.314744:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574305.314746:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787574305.314747:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574305.314748:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574305.314750:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787574305.314752:0:9503:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787574305.314754:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574305.314755:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787574305.314775:0:9503:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca53bf11000 from lustre-OST0001 10000000:01000000:0.0:1787574305.314819:0:9503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787574305.314822:0:9503:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787574305.314831:0:9503:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ca5050d4d28 local copy 10000000:01000000:0.0:1787574305.314836:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787574305.314870:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.314882:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.314892:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574305.314910:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346704512:0@lo:101: 00000100:00100000:0.0:1787574305.314942:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.315011:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574305.315456:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346704512 00000100:00100000:3.0:1787574305.315463:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346704512 00000100:00100000:3.0:1787574305.315531:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787574305.315540:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+14:9503:x1874407346704512:12345-0@lo:101: 00010000:00010000:3.0:1787574305.315551:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574305.315564:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7d68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7d61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.315586:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d61 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.315595:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d61 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.315605:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99800, rc 0) 00000100:00100000:3.0:1787574305.315675:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:9503:x1874407346704512:12345-0@lo:101: Request processed in 137us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.315682:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787574305.315727:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346704512:0@lo:101: 00010000:00010000:0.0:1787574305.315739:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.315748:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574305.315868:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346704640:0@lo:501: 00000100:00100000:0.0:1787574305.315894:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.315966:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574305.315994:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346704640 00000100:00100000:2.0:1787574305.315999:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346704640 00000100:00100000:2.0:1787574305.316019:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787574305.316024:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:9503:x1874407346704640:12345-0@lo:501: 00000100:00100000:2.0:1787574305.316083:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:9503:x1874407346704640:12345-0@lo:501: Request processed in 58us (187us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574305.316089:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787574305.316186:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346704640:0@lo:501: 10000000:01000000:0.0:1787574305.316197:0:9503:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787574305.316211:0:9503:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787574305.316216:0:9503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.320001:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.320023:0:9503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.320078:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787574305.320121:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca53bf11000 10000000:01000000:0.0:1787574305.320127:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787574305.320133:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787574305.320136:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787574305.320140:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787574305.320143:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787574305.320178:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.320186:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.320215:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574305.320266:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346704768:0@lo:101: 00000100:00100000:0.0:1787574305.320326:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.320362:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574305.320483:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346704768 00000100:00100000:2.0:1787574305.320490:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346704768 00000100:00100000:2.0:1787574305.320539:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787574305.320549:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:9503:x1874407346704768:12345-0@lo:101: 00010000:00010000:2.0:1787574305.320561:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574305.320572:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb7d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7d6f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.320593:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb7d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d6f expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.320603:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb7d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d6f expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.320612:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83400, rc 0) 00000100:00100000:2.0:1787574305.320649:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346704768:12345-0@lo:101: Request processed in 101us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.320655:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:2.0:1787574305.320685:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574305.320696:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.320703:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574305.320707:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.320716:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574305.320722:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574305.320734:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787574305.320753:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.320759:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574305.320780:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.320787:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7d61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd18a1efeeddb7d68 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.320807:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574305.320809:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574305.320811:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574305.321382:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346704896:0@lo:103: 00000100:00100000:2.0:1787574305.321418:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.321685:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346704768:0@lo:101: 00010000:00010000:0.0:1787574305.321701:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.321710:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574305.321807:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705024:0@lo:501: 00000100:00100000:0.0:1787574305.321833:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.321855:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574305.321897:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346705024 00000100:00100000:2.0:1787574305.321903:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346705024 00000100:00100000:2.0:1787574305.321937:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787574305.321946:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705024:12345-0@lo:501: 00000100:00100000:2.0:1787574305.322043:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705024:12345-0@lo:501: Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.322050:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787574305.322116:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705024:0@lo:501: 00000100:00100000:0.0:1787574305.322141:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705152:0@lo:503: 00000100:00100000:0.0:1787574305.322182:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.322203:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574305.322351:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346705152 00000100:00100000:2.0:1787574305.322355:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346705152 00000100:00100000:2.0:1787574305.322377:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787574305.322383:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705152:12345-0@lo:503: 00000100:00100000:2.0:1787574305.322460:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705152:12345-0@lo:503: Request processed in 76us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.322467:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787574305.322542:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705152:0@lo:503: 00000040:00080000:0.0:1787574305.322794:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787574305.322867:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705280:0@lo:502: 00000100:00100000:0.0:1787574305.322899:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.322928:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574305.322977:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346705280 00000100:00100000:2.0:1787574305.322981:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346705280 00000100:00100000:2.0:1787574305.323008:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787574305.323014:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705280:12345-0@lo:502: 00000100:00100000:2.0:1787574305.323076:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705280:12345-0@lo:502: Request processed in 62us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.323083:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787574305.323149:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705280:0@lo:502: 00000040:00080000:0.0:1787574305.323539:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787574305.323565:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787574305.323594:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787574305.323610:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787574305.323623:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787574305.323635:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787574305.323655:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705408:0@lo:502: 00000100:00100000:0.0:1787574305.323686:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.323747:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574305.323810:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346705408 00000100:00100000:3.0:1787574305.323815:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346705408 00000100:00100000:3.0:1787574305.323828:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346704896 00000100:00100000:3.0:1787574305.323832:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346704896 00000100:00100000:3.0:1787574305.323873:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574305.323882:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:3635:x1874407346704896:12345-0@lo:103: 00010000:00010000:3.0:1787574305.323892:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574305.323915:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7d68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7d61 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.323931:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574305.323966:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:3635:x1874407346704896:12345-0@lo:103: Request processed in 86us (2547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.323973:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574305.324003:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346704896:0@lo:103: 00000100:00100000:2.0:1787574305.324149:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787574305.324158:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:9503:x1874407346705408:12345-0@lo:502: 00000100:00100000:2.0:1787574305.324473:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:9503:x1874407346705408:12345-0@lo:502: Request processed in 316us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.324479:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787574305.324609:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705408:0@lo:502: 00000040:00080000:0.0:1787574305.324658:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787574305.324669:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1787574305.325105:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787574305.325112:0:9514:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787574305.325119:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574305.325121:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787574305.325127:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574305.325141:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ca52f334d28) 00000020:00000080:1.0:1787574305.325165:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787574305.325174:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787574305.325531:0:9514:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53bf11000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787574305.325539:0:9514:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787574305.325545:0:9514:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd18a1efeeddb7d84 00010000:00010000:1.0:1787574305.330899:0:9514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1787574305.331183:0:9514:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787574305.344149:0:9514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787574305.344549:0:9514:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787574305.354880:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787574305.355100:0:9514:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787574305.362725:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787574305.364102:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787574305.364115:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574305.364122:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574305.364124:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787574305.364127:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574305.364131:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574305.364132:0:9514:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787574305.364135:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574305.364137:0:9514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787574305.364159:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574305.364161:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574305.364163:0:9514:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787574305.364172:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787574305.365500:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787574305.365542:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787574305.365615:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.365628:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574305.365637:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53bf11000 from 1 10000000:01000000:2.0:1787574305.365640:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574305.365677:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.365699:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.365721:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.365746:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705536:0@lo:101: 00000100:00100000:2.0:1787574305.365833:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574305.365872:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53be97480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574305.365896:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346705536 00000100:00100000:2.0:1787574305.365904:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346705536 00000100:00100000:2.0:1787574305.365956:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787574305.365966:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:9503:x1874407346705536:12345-0@lo:101: 00010000:00010000:2.0:1787574305.365979:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574305.365991:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83000/0xd18a1efeeddb7d92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7d8b expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.366015:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83000/0xd18a1efeeddb7d92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d8b expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.366026:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83000/0xd18a1efeeddb7d92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d8b expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.366035:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83000, rc 0) 00000100:00100000:2.0:1787574305.366076:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705536:12345-0@lo:101: Request processed in 111us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.366082:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787574305.366125:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705536:0@lo:101: 00010000:00010000:2.0:1787574305.366144:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.366152:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.366272:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705664:0@lo:501: 00000100:00100000:2.0:1787574305.366297:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574305.366311:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53be97480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574305.367841:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346705664 00000100:00100000:1.0:1787574305.367853:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346705664 00000100:00100000:1.0:1787574305.367894:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787574305.367902:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705664:12345-0@lo:501: 00000100:00100000:1.0:1787574305.368029:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705664:12345-0@lo:501: Request processed in 128us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574305.368036:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787574305.368225:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705664:0@lo:501: 00000100:00100000:2.0:1787574305.368287:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705792:0@lo:503: 00000100:00100000:2.0:1787574305.368334:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574305.368362:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53be97480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574305.368378:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346705792 00000100:00100000:2.0:1787574305.368382:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346705792 00000100:00100000:2.0:1787574305.368401:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787574305.368407:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705792:12345-0@lo:503: 00000100:00100000:2.0:1787574305.368478:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705792:12345-0@lo:503: Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.368485:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787574305.368523:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705792:0@lo:503: 00000040:00080000:2.0:1787574305.369071:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787574305.369138:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705920:0@lo:502: 00000100:00100000:2.0:1787574305.369175:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574305.369210:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53be97480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574305.369339:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346705920 00000100:00100000:1.0:1787574305.369344:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346705920 00000100:00100000:1.0:1787574305.369375:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787574305.369382:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705920:12345-0@lo:502: 00000100:00100000:1.0:1787574305.372544:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346705920:12345-0@lo:502: Request processed in 3152us (3358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574305.372559:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787574305.374977:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346705920:0@lo:502: 00000040:00080000:3.0:1787574305.375216:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787574305.375282:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787574305.375320:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402725180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706048:0@lo:502: 00000100:00100000:3.0:1787574305.375392:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.375430:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bf23d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574305.375628:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346706048 00000100:00100000:2.0:1787574305.375640:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346706048 00000100:00100000:2.0:1787574305.375690:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787574305.375700:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346706048:12345-0@lo:502: 00000100:00100000:2.0:1787574305.375838:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346706048:12345-0@lo:502: Request processed in 140us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.375846:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787574305.375982:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402725180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706048:0@lo:502: 00000040:00080000:1.0:1787574305.376027:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787574305.376037:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787574305.377493:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574305.377506:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574305.377508:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787574305.377515:0:9518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca53bf11000 00000020:00000080:3.0:1787574305.377518:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787574305.377531:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574305.377534:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574305.377535:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787574305.377539:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787574305.377676:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787574305.377701:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574305.377810:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.377821:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574305.377868:0:9503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787574305.377871:0:9503:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca53bf11000 10000000:01000000:1.0:1787574305.377881:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca53bf11000 10000000:01000000:1.0:1787574305.377884:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787574305.377890:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca53bf11000 from 1 10000000:01000000:1.0:1787574305.377893:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787574305.377924:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.377932:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.377942:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574305.377963:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706176:0@lo:101: 00000100:00100000:1.0:1787574305.378022:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574305.378068:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574305.378119:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346706176 00000100:00100000:2.0:1787574305.378126:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346706176 00000100:00100000:2.0:1787574305.378171:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787574305.378181:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9503:x1874407346706176:12345-0@lo:101: 00010000:00010000:2.0:1787574305.378193:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574305.378206:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb7da0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7d99 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.378260:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb7da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d99 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.378272:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb7da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d99 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.378280:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83200, rc 0) 00000100:00100000:2.0:1787574305.378320:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9503:x1874407346706176:12345-0@lo:101: Request processed in 141us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.378327:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787574305.378467:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706176:0@lo:101: 00010000:00010000:1.0:1787574305.378480:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.378489:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574305.378558:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706304:0@lo:501: 00000100:00100000:1.0:1787574305.378583:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574305.378605:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574305.378664:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346706304 00000100:00100000:0.0:1787574305.378668:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346706304 00000100:00100000:0.0:1787574305.378701:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787574305.378718:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9503:x1874407346706304:12345-0@lo:501: 00000100:00100000:0.0:1787574305.378822:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9503:x1874407346706304:12345-0@lo:501: Request processed in 114us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.378829:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787574305.378860:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706304:0@lo:501: 00000100:00100000:0.0:1787574305.378884:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706432:0@lo:503: 00000100:00100000:0.0:1787574305.378924:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.378943:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787574305.378955:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346706432 00000100:00100000:0.0:1787574305.378958:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346706432 00000100:00100000:0.0:1787574305.378974:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787574305.378988:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9503:x1874407346706432:12345-0@lo:503: 00000100:00100000:0.0:1787574305.379055:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9503:x1874407346706432:12345-0@lo:503: Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.379062:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787574305.379098:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706432:0@lo:503: 00000040:00080000:0.0:1787574305.379342:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787574305.379395:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706560:0@lo:502: 00000100:00100000:0.0:1787574305.379429:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.379450:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787574305.379462:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346706560 00000100:00100000:0.0:1787574305.379466:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346706560 00000100:00100000:0.0:1787574305.379483:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787574305.379490:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9503:x1874407346706560:12345-0@lo:502: 00000100:00100000:0.0:1787574305.379557:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9503:x1874407346706560:12345-0@lo:502: Request processed in 67us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.379563:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787574305.379597:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706560:0@lo:502: 00000040:00080000:0.0:1787574305.379755:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787574305.379779:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787574305.379793:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787574305.379821:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787574305.379834:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787574305.379848:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787574305.379863:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787574305.379877:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787574305.379892:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787574305.379907:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787574305.379932:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787574305.379947:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787574305.379960:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787574305.379973:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787574305.379987:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787574305.380001:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787574305.380015:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787574305.380044:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787574305.380060:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787574305.380073:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787574305.380085:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787574305.380100:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787574305.380114:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787574305.380128:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787574305.380139:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787574305.380151:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787574305.380164:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787574305.380178:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787574305.380192:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787574305.380206:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787574305.380220:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787574305.380234:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787574305.380275:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787574305.380299:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787574305.380314:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787574305.380325:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787574305.380336:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1787574305.380349:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787574305.380362:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1787574305.380377:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1787574305.380389:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1787574305.380402:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1787574305.380414:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1787574305.380437:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1787574305.380450:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1787574305.380463:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1787574305.380488:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706688:0@lo:502: 00000100:00100000:0.0:1787574305.380528:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.380553:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787574305.380572:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346706688 00000100:00100000:0.0:1787574305.380577:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346706688 00000100:00100000:0.0:1787574305.380599:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787574305.380606:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9503:x1874407346706688:12345-0@lo:502: 00000100:00100000:0.0:1787574305.380682:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9503:x1874407346706688:12345-0@lo:502: Request processed in 76us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.380690:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787574305.380732:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346706688:0@lo:502: 00000040:00080000:0.0:1787574305.380765:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1787574305.380772:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1787574305.381692:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787574305.381720:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ca52f3319b8) 00000020:00000080:1.0:1787574305.381745:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1787574305.381837:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53bf11000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787574305.381841:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53bf11000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787574305.381844:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53bf11000 3 00010000:00080000:1.0:1787574305.381874:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca53b11f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1787574305.384075:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1787574305.384324:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787574305.384365:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787574305.384378:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd18a1efeeddb7dae 00000100:00080000:1.0:1787574305.384387:0:9519:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574305.384392:0:9519:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ca53b11f800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574305.384428:0:9519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca535d53800 x1874407346706816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574305.384460:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787574305.386735:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346706816:0@lo:38: 00000100:00100000:3.0:1787574305.386824:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.387986:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346706944:0@lo:400: 00000100:00100000:3.0:1787574305.388027:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.388059:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346707456:0@lo:400: 00000100:00100000:3.0:1787574305.388090:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.388113:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787574305.388119:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346707072:0@lo:400: 00000100:00100000:3.0:1787574305.388144:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.388161:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346707584:0@lo:400: 00000100:00100000:3.0:1787574305.388178:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.388203:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346707328:0@lo:400: 00000100:00100000:3.0:1787574305.388378:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.388399:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346707840:0@lo:400: 00000100:00100000:3.0:1787574305.388423:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.388440:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787574305.388445:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346707200:0@lo:400: 00000100:00100000:3.0:1787574305.388466:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.388477:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346707712:0@lo:400: 00000100:00100000:3.0:1787574305.388495:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.388522:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346706816 00000100:00100000:3.0:1787574305.388529:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346706816 00000100:00100000:3.0:1787574305.388555:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346706944 00000100:00100000:3.0:1787574305.388558:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346706944 00000100:00100000:3.0:1787574305.388579:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346707456 00000100:00100000:3.0:1787574305.388581:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346707456 00000100:00100000:3.0:1787574305.388602:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346707584 00000100:00100000:3.0:1787574305.388604:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346707584 00000100:00100000:3.0:1787574305.388615:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346707200 00000100:00100000:3.0:1787574305.388618:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346707200 00000100:00100000:3.0:1787574305.388632:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787574305.388640:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346706944:12345-0@lo:400: 00000100:00100000:3.0:1787574305.388688:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346706944:12345-0@lo:400: Request processed in 48us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.388702:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787574305.388829:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787574305.388840:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346707456:12345-0@lo:400: 00000100:00100000:0.0:1787574305.388874:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346707456:12345-0@lo:400: Request processed in 37us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.388880:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787574305.388898:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574305.388905:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346707584:12345-0@lo:400: 00000100:00100000:0.0:1787574305.388931:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346707584:12345-0@lo:400: Request processed in 27us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.388937:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574305.388949:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574305.388962:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346707200:12345-0@lo:400: 00000100:00100000:0.0:1787574305.388994:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346707200:12345-0@lo:400: Request processed in 33us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.389000:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574305.389012:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574305.389017:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346706816:12345-0@lo:38: 00010000:00080000:0.0:1787574305.389038:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:0.0:1787574305.389073:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd18a1efeeddb7db5 00000004:00100000:0.0:1787574305.389088:0:6509:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574305.389119:0:6509:0:(import.c:65:import_set_state_nolock()) ffff9ca40270e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574305.389159:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874407346706816:12345-0@lo:38: Request processed in 140us (2335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574305.389165:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574305.389291:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346707840 00000100:00100000:2.0:1787574305.389296:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346707840 00000100:00100000:2.0:1787574305.389339:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346707712 00000100:00100000:2.0:1787574305.389343:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346707712 00000100:00100000:2.0:1787574305.389366:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574305.389374:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346707840:12345-0@lo:400: 00000100:00100000:2.0:1787574305.389415:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346707840:12345-0@lo:400: Request processed in 43us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.389421:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574305.389433:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574305.389439:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346707712:12345-0@lo:400: 00000100:00100000:2.0:1787574305.389464:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346707712:12345-0@lo:400: Request processed in 25us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.389470:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787574305.389489:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574305.389494:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574305.389496:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574305.390054:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346707072 00000100:00100000:3.0:1787574305.390060:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346707072 00000100:00100000:3.0:1787574305.390080:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346707328 00000100:00100000:3.0:1787574305.390083:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346707328 00000100:00100000:3.0:1787574305.390098:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787574305.390104:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346707072:12345-0@lo:400: 00000100:00100000:3.0:1787574305.390146:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346707072:12345-0@lo:400: Request processed in 42us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.390152:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787574305.390165:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787574305.390170:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346707328:12345-0@lo:400: 00000100:00100000:3.0:1787574305.390198:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346707328:12345-0@lo:400: Request processed in 28us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.390204:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574305.390413:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346707072:0@lo:400: 00010000:00080000:2.0:1787574305.390431:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019edf80 x1874407346707584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574305.390442:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346707584:0@lo:400: 00010000:00080000:2.0:1787574305.390455:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019ed880 x1874407346706944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574305.390465:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346706944:0@lo:400: 00010000:00080000:2.0:1787574305.390477:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019eca80 x1874407346707456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574305.390486:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346707456:0@lo:400: 00010000:00080000:3.0:1787574305.391416:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4019eed80 x1874407346707200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574305.391429:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346707200:0@lo:400: 00010000:00080000:3.0:1787574305.391441:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5350e7b80 x1874407346707712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574305.391451:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346707712:0@lo:400: 00000100:00100000:3.0:1787574305.391461:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346707328:0@lo:400: 00010000:00080000:3.0:1787574305.391471:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5350e5880 x1874407346707840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574305.391479:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346707840:0@lo:400: 00010000:00080000:3.0:1787574305.391532:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca535d53800 x1874407346706816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574305.391540:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574305.391547:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787574305.391555:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787574305.391561:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787574305.391563:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca53b11f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787574305.391570:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346706816:0@lo:38: 00000020:01000004:1.0:1787574305.396660:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787574305.396693:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ca4032c8000) 00000020:00000080:1.0:1787574305.396730:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1787574305.396836:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53bf11000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787574305.396841:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53bf11000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787574305.396843:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53bf11000 3 00010000:00080000:1.0:1787574305.396875:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca52f20b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.140@tcp at head 00000100:00100000:0.0:1787574305.399428:0:9520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9520:1874407346707968:0@lo:901: 00000100:00100000:0.0:1787574305.399501:0:9520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574305.399537:0:9520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787574305.399607:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346707968 00000100:00100000:2.0:1787574305.399614:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346707968 00000100:00100000:2.0:1787574305.399678:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574305.399688:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9520:x1874407346707968:12345-0@lo:901: 00000100:00100000:2.0:1787574305.399808:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9520:x1874407346707968:12345-0@lo:901: Request processed in 120us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574305.399815:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787574305.399865:0:9520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5350e5f80 x1874407346707968/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787574321 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574305.399879:0:9520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9520:1874407346707968:0@lo:901: 00000100:00080000:0.0:1787574305.400122:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787574305.400597:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1787574305.403457:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787574305.403510:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787574305.403523:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd18a1efeeddb7dc3 00000100:00080000:1.0:1787574305.403533:0:9519:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574305.403539:0:9519:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ca52f20b800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574305.403575:0:9519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca535d52680 x1874407346708096/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574305.403605:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787574305.403691:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1874407346708096:0@lo:38: 00000100:00100000:2.0:1787574305.403767:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574305.403939:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346708096 00000100:00100000:1.0:1787574305.403946:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346708096 00000100:00100000:1.0:1787574305.403987:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574305.403995:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346708096:12345-0@lo:38: 00010000:00080000:1.0:1787574305.404019:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1787574305.404060:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd18a1efeeddb7dca 00000004:00100000:1.0:1787574305.404075:0:6509:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787574305.404107:0:6509:0:(import.c:65:import_set_state_nolock()) ffff9ca4033da000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574305.404160:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874407346708096:12345-0@lo:38: Request processed in 163us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574305.404168:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787574305.404496:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca535d52680 x1874407346708096/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574305.404507:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574305.404514:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787574305.404521:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787574305.404525:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787574305.404527:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca52f20b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787574305.404533:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1874407346708096:0@lo:38: 00000040:00080000:3.0:1787574305.406834:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1787574305.409693:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1787574305.409749:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574305.409780:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574305.409802:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787574305.409863:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787574305.409865:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787574305.409870:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574305.409872:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574305.409873:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574305.409874:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574305.409876:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574305.409877:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574305.409879:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574305.409880:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574305.409882:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574305.409885:0:9503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787574305.409887:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574305.409889:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787574305.409890:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574305.409891:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574305.409892:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574305.409893:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574305.409894:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574305.409895:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574305.409896:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574305.409897:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574305.409898:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574305.409925:0:9503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787574305.409944:0:9503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346708224:0@lo:253: 00000100:00100000:2.0:1787574305.410014:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574305.410048:0:9503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53be97f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574305.410635:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346708224 00000100:00100000:1.0:1787574305.410643:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346708224 00000100:00100000:1.0:1787574305.410700:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787574305.411077:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9503:x1874407346708224:12345-0@lo:253: 20000000:01000000:1.0:1787574305.411108:0:6504:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787574305.411124:0:6504:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787574305.418196:0:6504:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787574305.418596:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787574305.418999:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9503:x1874407346708224:12345-0@lo:253: Request processed in 7922us (8977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574305.419013:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 20000000:01000000:0.0:1787574305.419150:0:6525:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787574305.419155:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787574305.419179:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.419194:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7cc0 expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.419203:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d06 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574305.419226:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574305.419295:0:9503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9503:1874407346708224:0@lo:253: 10000000:01000000:2.0:1787574305.419310:0:9503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787574305.419314:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574305.419316:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787574305.419317:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574305.419318:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574305.419320:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574305.419321:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574305.419322:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574305.419324:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787574305.419325:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787574305.419327:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574305.419328:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787574305.419349:0:9503:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787574305.419517:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7d06 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.419531:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7d0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d06 expref: 16 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574305.419545:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346708352:0@lo:104: 00000100:00100000:1.0:1787574305.419646:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574305.421492:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7cc0 expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.421511:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7cc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cc0 expref: 16 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574305.421525:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346708480:0@lo:104: 00000100:00100000:1.0:1787574305.421983:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574305.425894:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6240 going to sleep for 11 seconds 00080000:10000000:2.0:1787574305.425966:0:9503:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787574305.426156:0:9503:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787574305.426937:0:9503:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787574305.427094:0:9503:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:3.0:1787574305.427373:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346708352 00000100:00100000:3.0:1787574305.427382:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346708352 00000100:00100000:3.0:1787574305.427404:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346708480 00000100:00100000:3.0:1787574305.427407:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346708480 00000100:00100000:3.0:1787574305.427444:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574305.427454:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6525:x1874407346708480:12345-0@lo:104: 00010000:00010000:3.0:1787574305.427472:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.427565:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787574305.427692:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346708480:0@lo:104: 00000100:00100000:3.0:1787574305.427854:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:6525:x1874407346708480:12345-0@lo:104: Request processed in 401us (5871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.427862:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574305.427918:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574305.427924:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6525:x1874407346708352:12345-0@lo:104: 00010000:00010000:3.0:1787574305.427933:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574305.427990:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1874407346708352:0@lo:104: 00010000:00010000:3.0:1787574305.428015:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.428034:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787574305.428039:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:6525:x1874407346708352:12345-0@lo:104: Request processed in 116us (8395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.428046:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787574305.428058:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574305.428064:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.428071:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb800 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574305.428075:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.428084:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574305.428092:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574305.428098:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574305.428127:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.428134:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574305.428149:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.428165:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb7cc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7cc7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.428177:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574305.428180:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.428185:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574305.428188:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.428195:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574305.428202:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574305.428207:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574305.428220:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.428226:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574305.428231:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.428261:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7d06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d0d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.428275:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574305.428282:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574305.428284:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574305.428388:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1787574305.428551:0:9503:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787574305.429010:0:9503:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:3.0:1787574305.429384:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346708608:0@lo:103: 00000100:00100000:3.0:1787574305.429436:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.429475:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574305.429481:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346708736:0@lo:103: 00000100:00100000:3.0:1787574305.429500:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1787574305.430477:0:9503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787574305.433558:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346708608 00000100:00100000:1.0:1787574305.433583:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346708608 00010000:00010000:1.0:1787574305.433628:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7cc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cc0 expref: 17 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574305.433664:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346708736 00000100:00100000:1.0:1787574305.433668:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346708736 00010000:00010000:1.0:1787574305.433680:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7d0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d06 expref: 18 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574305.433708:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787574305.433727:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:3636:x1874407346708608:12345-0@lo:103: 00000100:00100000:3.0:1787574305.433844:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574305.433853:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402725c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:3636:x1874407346708736:12345-0@lo:103: 00010000:00010000:3.0:1787574305.433862:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574305.433868:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7d0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d06 expref: 18 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.433883:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d06 expref: 18 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.433899:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7d0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7d06 expref: 18 pid: 6503 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.433916:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574305.433989:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402725c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:3636:x1874407346708736:12345-0@lo:103: Request processed in 138us (4487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.433996:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574305.434045:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346708736:0@lo:103: 00010000:00010000:1.0:1787574305.434165:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574305.434172:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7cc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cc0 expref: 16 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.434182:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7cc0 expref: 16 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.434209:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7cc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7cc0 expref: 16 pid: 6501 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.434221:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.434229:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787574305.434272:0:6495:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024863812s 00010000:00010000:1.0:1787574305.434276:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.434282:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.434296:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.434302:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.434307:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574305.434311:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.434318:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.434335:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574305.434357:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574305.434390:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:3636:x1874407346708608:12345-0@lo:103: Request processed in 665us (4954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574305.434397:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574305.434876:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346708608:0@lo:103: 00010000:00010000:3.0:1787574305.434903:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.434922:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574305.434929:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7dd1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787574305.441137:0:9503:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787574305.441146:0:9503:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787574305.441186:0:9503:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787574305.441231:0:9503:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787574305.441283:0:9503:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787574305.441317:0:9503:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787574305.442506:0:9503:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574305.442918:0:9503:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787574305.457819:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574305.530783:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346708864:0@lo:13: 00000100:00100000:3.0:1787574305.530864:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574305.530975:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346708864 00000100:00100000:3.0:1787574305.530983:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346708864 00000100:00100000:3.0:1787574305.531023:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574305.531033:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346708864:12345-0@lo:13: 00002000:00000024:3.0:1787574305.531057:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574305.531090:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346708864:12345-0@lo:13: Request processed in 60us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574305.531095:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787574305.531135:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402726a00 x1874407346708864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574305.531149:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346708864:0@lo:13: 00000100:00100000:3.0:1787574305.531636:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346708992:0@lo:13: 00000100:00100000:3.0:1787574305.531673:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574305.532364:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346708992 00000100:00100000:1.0:1787574305.532370:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346708992 00000100:00100000:1.0:1787574305.532400:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574305.532406:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346708992:12345-0@lo:13: 00002000:00000024:1.0:1787574305.532417:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574305.532445:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346708992:12345-0@lo:13: Request processed in 40us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574305.532449:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787574305.532936:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d51880 x1874407346708992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574305.532954:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346708992:0@lo:13: 00010000:00010000:3.0:1787574306.482957:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787574306.882669:0:9575:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787574306.882946:0:9575:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787574307.059336:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346709120:0@lo:41: 00000100:00100000:1.0:1787574307.059414:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574307.059764:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346709120 00000100:00100000:0.0:1787574307.059773:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346709120 00000100:00100000:0.0:1787574307.059840:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787574307.059850:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346709120:12345-0@lo:41: 00000004:00000024:0.0:1787574307.059885:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1787574307.059942:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346709120:12345-0@lo:41: Request processed in 93us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574307.059948:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787574307.060470:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346709120:0@lo:41: 00010000:00010000:0.0:1787574307.505653:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574307.570685:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574307.570721:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346709248:0@lo:41: 00000100:00100000:0.0:1787574307.570801:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574307.571019:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346709248 00000100:00100000:1.0:1787574307.571027:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346709248 00000100:00100000:1.0:1787574307.571082:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787574307.571093:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346709248:12345-0@lo:41: 00000004:00000024:1.0:1787574307.571125:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787574307.571175:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346709248:12345-0@lo:41: Request processed in 85us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574307.571182:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787574307.571666:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346709248:0@lo:41: 00010000:00010000:3.0:1787574308.530016:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574309.555719:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574310.593207:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574310.642153:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346709504:0@lo:400: 00000100:00100000:0.0:1787574310.642223:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574310.642296:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346710016:0@lo:400: 00000100:00100000:1.0:1787574310.642639:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346709376:0@lo:400: 00000100:00100000:3.0:1787574310.643027:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346709760:0@lo:400: 00000100:00100000:1.0:1787574310.647206:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574310.647282:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346709888:0@lo:400: 00000100:00100000:2.0:1787574310.653266:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346709632:0@lo:400: 00000100:00100000:1.0:1787574310.653576:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574310.653618:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346710400:0@lo:400: 00000100:00100000:1.0:1787574310.653647:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574310.653725:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346709376 00000100:00100000:1.0:1787574310.653732:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346709376 00000100:00100000:1.0:1787574310.653789:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787574310.653799:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:3634:x1874407346709376:12345-0@lo:400: 00000100:00100000:0.0:1787574310.654130:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574310.654284:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346709504 00000100:00100000:0.0:1787574310.654289:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346709504 00000100:00100000:0.0:1787574310.654335:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346710016 00000100:00100000:0.0:1787574310.654348:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346710016 00000100:00100000:0.0:1787574310.654379:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787574310.654387:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346709504:12345-0@lo:400: 00000100:00100000:0.0:1787574310.654443:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346709504:12345-0@lo:400: Request processed in 57us (12220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574310.654450:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787574310.654466:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574310.654473:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346710016:12345-0@lo:400: 00000100:00100000:0.0:1787574310.654498:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346710016:12345-0@lo:400: Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574310.654504:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787574310.654520:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787574310.654662:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403485180 x1874407346710016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574310.654676:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346710016:0@lo:400: 00000100:00100000:0.0:1787574310.654685:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346710528:0@lo:400: 00000100:00100000:0.0:1787574310.654708:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574310.654726:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346710528 00000100:00100000:0.0:1787574310.654729:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346710528 00000100:00100000:0.0:1787574310.654765:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787574310.654772:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346710528:12345-0@lo:400: 00000100:00100000:0.0:1787574310.654803:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346710528:12345-0@lo:400: Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574310.654808:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787574310.654835:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787574310.654851:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403486d80 x1874407346710528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574310.654884:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346710528:0@lo:400: 00010000:00080000:0.0:1787574310.654917:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403485880 x1874407346709504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574310.654925:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346709504:0@lo:400: 00000100:00100000:0.0:1787574310.654933:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574310.654939:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346710912:0@lo:13: 00000100:00100000:0.0:1787574310.654965:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574310.655058:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346710400 00000100:00100000:0.0:1787574310.655062:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346710400 00000100:00100000:0.0:1787574310.655093:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574310.655099:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346710400:12345-0@lo:400: 00000100:00100000:0.0:1787574310.655133:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346710400:12345-0@lo:400: Request processed in 35us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574310.655139:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574310.655156:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346709888 00000100:00100000:0.0:1787574310.655161:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346709888 00000100:00100000:0.0:1787574310.655184:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787574310.655190:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346709888:12345-0@lo:400: 00000100:00100000:0.0:1787574310.655222:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346709888:12345-0@lo:400: Request processed in 33us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574310.655228:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1787574310.655261:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574310.655283:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346709888:0@lo:400: 00010000:00080000:0.0:1787574310.655293:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403487100 x1874407346710400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574310.655316:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346710400:0@lo:400: 00000100:00100000:0.0:1787574310.656927:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346710912 00000100:00100000:0.0:1787574310.656937:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346710912 00000100:00100000:0.0:1787574310.656984:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787574310.656993:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346710912:12345-0@lo:13: 00002000:00000024:0.0:1787574310.657019:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574310.657080:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346710912:12345-0@lo:13: Request processed in 88us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574310.657087:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787574310.657123:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d50e00 x1874407346710912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574310.657143:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346710912:0@lo:13: 00000100:00100000:2.0:1787574310.658172:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574310.658207:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346709632 00000100:00100000:2.0:1787574310.658212:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346709632 00000100:00100000:2.0:1787574310.658258:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787574310.658267:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346709632:12345-0@lo:400: 00000100:00100000:2.0:1787574310.658312:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346709632:12345-0@lo:400: Request processed in 47us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574310.658319:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787574310.658355:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346709632:0@lo:400: 00000100:00100000:2.0:1787574310.658366:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346710144:0@lo:400: 00000100:00100000:2.0:1787574310.658396:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574310.658634:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346710144 00000100:00100000:2.0:1787574310.658638:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346710144 00000100:00100000:2.0:1787574310.658674:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787574310.658680:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346710144:12345-0@lo:400: 00000100:00100000:1.0:1787574310.666460:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:3634:x1874407346709376:12345-0@lo:400: Request processed in 12650us (19251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574310.666474:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787574310.666538:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346709376:0@lo:400: 00000100:00080000:1.0:1787574310.666616:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574310.666637:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346710656:0@lo:400: 00000100:00100000:1.0:1787574310.666680:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574310.666709:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346710656 00000100:00100000:1.0:1787574310.666715:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346710656 00000100:00100000:1.0:1787574310.666771:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787574310.666780:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346710656:12345-0@lo:400: 00000100:00100000:1.0:1787574310.666830:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346710656:12345-0@lo:400: Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574310.666836:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787574310.666848:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787574310.666865:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403484a80 x1874407346710656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574310.666902:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346710656:0@lo:400: 00000100:00100000:2.0:1787574310.681060:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346710144:12345-0@lo:400: Request processed in 22372us (22655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574310.681084:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787574310.683765:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403484e00 x1874407346710144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574310.683784:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346710144:0@lo:400: 00000100:00100000:3.0:1787574310.687269:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574310.687322:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346710272:0@lo:400: 00000100:00100000:3.0:1787574310.687364:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574310.687396:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346710272 00000100:00100000:3.0:1787574310.687404:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346710272 00000100:00100000:1.0:1787574310.687680:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346709760 00000100:00100000:1.0:1787574310.687685:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346709760 00000100:00100000:1.0:1787574310.687737:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787574310.687757:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346709760:12345-0@lo:400: 00000100:00100000:1.0:1787574310.687825:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346709760:12345-0@lo:400: Request processed in 68us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574310.687832:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574310.688057:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574310.688064:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346710272:12345-0@lo:400: 00000100:00100000:3.0:1787574310.688097:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346710272:12345-0@lo:400: Request processed in 34us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574310.688104:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787574310.688138:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403487b80 x1874407346710272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574310.688152:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346710272:0@lo:400: 00000100:00100000:3.0:1787574310.688160:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346710784:0@lo:13: 00000100:00100000:3.0:1787574310.688184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574310.688206:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346710784 00000100:00100000:3.0:1787574310.688210:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346710784 00000100:00100000:3.0:1787574310.688232:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787574310.688254:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346710784:12345-0@lo:13: 00002000:00000024:3.0:1787574310.688281:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574310.688313:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346710784:12345-0@lo:13: Request processed in 75us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574310.688319:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787574310.688344:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402727480 x1874407346710784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574310.688359:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346710784:0@lo:13: 00010000:00080000:3.0:1787574310.688387:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403487480 x1874407346709760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574310.688395:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346709760:0@lo:400: 00000100:00080000:1.0:1787574310.717278:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787574311.614005:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787574312.177867:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787574312.177875:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca53bc3a000 from 39 10000000:01000000:3.0:1787574312.177880:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787574312.177930:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574312.177942:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574312.177953:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574312.177978:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346711040:0@lo:101: 00000100:00100000:3.0:1787574312.178047:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574312.178095:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.178990:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346711040 00000100:00100000:1.0:1787574312.179000:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346711040 00000100:00100000:1.0:1787574312.179055:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787574312.179066:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346711040:12345-0@lo:101: 00010000:00010000:1.0:1787574312.179081:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574312.179095:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb7ddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7dd8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.179119:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb7ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7dd8 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.179130:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb7ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7dd8 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.179139:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75200, rc 0) 00000100:00100000:1.0:1787574312.179204:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346711040:12345-0@lo:101: Request processed in 140us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.179211:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787574312.179347:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574312.179361:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346711168:0@lo:41: 00000100:00100000:0.0:1787574312.179394:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.179440:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346711168 00000100:00100000:0.0:1787574312.179444:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346711168 00000100:00100000:0.0:1787574312.179474:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787574312.179481:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346711168:12345-0@lo:41: 00000004:00000024:0.0:1787574312.179505:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1787574312.179540:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346711168:12345-0@lo:41: Request processed in 60us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.179546:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787574312.179586:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346711168:0@lo:41: 00000100:00100000:3.0:1787574312.180015:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346711040:0@lo:101: 00010000:00010000:3.0:1787574312.180039:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574312.180049:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574312.180107:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346711296:0@lo:501: 00000100:00100000:3.0:1787574312.180136:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574312.180168:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.180228:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346711296 00000100:00100000:0.0:1787574312.180258:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346711296 00000100:00100000:0.0:1787574312.180294:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787574312.180300:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346711296:12345-0@lo:501: 00000100:00100000:0.0:1787574312.180431:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346711296:12345-0@lo:501: Request processed in 130us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.180438:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787574312.182572:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346711296:0@lo:501: 00000100:00100000:3.0:1787574312.182637:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346711424:0@lo:503: 00000100:00100000:3.0:1787574312.182699:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574312.182749:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.182818:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346711424 00000100:00100000:0.0:1787574312.182824:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346711424 00000100:00100000:0.0:1787574312.182872:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787574312.182881:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346711424:12345-0@lo:503: 00000100:00100000:0.0:1787574312.182987:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346711424:12345-0@lo:503: Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.182995:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787574312.183352:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346711424:0@lo:503: 00000100:00100000:1.0:1787574312.214671:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9769:1874407346711552:0@lo:502: 00000100:00100000:1.0:1787574312.214760:0:9769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574312.214791:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346711552 00000100:00100000:3.0:1787574312.214798:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346711552 00000100:00100000:1.0:1787574312.214799:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6300 going to sleep for 11 seconds 00000100:00100000:3.0:1787574312.214846:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787574312.214856:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9769:x1874407346711552:12345-0@lo:502: 00000100:00100000:3.0:1787574312.214975:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9769:x1874407346711552:12345-0@lo:502: Request processed in 120us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574312.214982:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787574312.216144:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9769:1874407346711552:0@lo:502: 00000100:00100000:1.0:1787574312.216200:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9769:1874407346711680:0@lo:502: 00000100:00100000:1.0:1787574312.216253:0:9769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.216278:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346711680 00000100:00100000:1.0:1787574312.216283:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346711680 00000100:00100000:1.0:1787574312.216316:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787574312.216323:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9769:x1874407346711680:12345-0@lo:502: 00000100:00100000:1.0:1787574312.216403:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:9769:x1874407346711680:12345-0@lo:502: Request processed in 80us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.216410:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787574312.216459:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.216471:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9769:1874407346711680:0@lo:502: 00000040:00080000:1.0:1787574312.216488:0:9769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787574312.225709:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787574312.225761:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787574312.225773:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574312.225785:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574312.225819:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787574312.225823:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787574312.225826:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787574312.225864:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574312.225872:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574312.225883:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574312.225906:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346711808:0@lo:101: 00000100:00100000:3.0:1787574312.225970:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574312.226016:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.226016:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346711808 00000100:00100000:1.0:1787574312.226024:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346711808 00000100:00100000:1.0:1787574312.226073:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787574312.226083:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346711808:12345-0@lo:101: 00010000:00010000:1.0:1787574312.226094:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574312.226107:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7ded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7de6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.226153:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7de6 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.226163:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7de6 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.226171:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74600, rc 0) 00000100:00100000:1.0:1787574312.226218:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346711808:12345-0@lo:101: Request processed in 136us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.226224:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787574312.226231:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346711808:0@lo:101: 00010000:00010000:0.0:1787574312.226262:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.226271:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574312.226328:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346711936:0@lo:501: 00000100:00100000:0.0:1787574312.226356:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.226384:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.226616:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346711936 00000100:00100000:1.0:1787574312.226621:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346711936 00000100:00100000:1.0:1787574312.226648:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787574312.226656:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346711936:12345-0@lo:501: 00000100:00100000:1.0:1787574312.226789:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346711936:12345-0@lo:501: Request processed in 133us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.226796:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787574312.226826:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346711936:0@lo:501: 00000100:00100000:1.0:1787574312.226872:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346712064:0@lo:503: 00000100:00100000:1.0:1787574312.226910:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.226924:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.226935:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346712064 00000100:00100000:1.0:1787574312.226938:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346712064 00000100:00100000:1.0:1787574312.226954:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787574312.226959:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346712064:12345-0@lo:503: 00000100:00100000:1.0:1787574312.227032:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346712064:12345-0@lo:503: Request processed in 71us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.227043:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787574312.227081:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346712064:0@lo:503: 00000100:00100000:1.0:1787574312.227276:0:9773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9773:1874407346712192:0@lo:502: 00000100:00100000:1.0:1787574312.227308:0:9773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.227326:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346712192 00000100:00100000:1.0:1787574312.227329:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346712192 00000100:00100000:1.0:1787574312.227347:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787574312.227353:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9773:x1874407346712192:12345-0@lo:502: 00000100:00100000:1.0:1787574312.227419:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9773:x1874407346712192:12345-0@lo:502: Request processed in 65us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.227425:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787574312.227456:0:9773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.227467:0:9773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9773:1874407346712192:0@lo:502: 00000020:01000000:1.0:1787574312.227487:0:9773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574312.227494:0:9773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574312.227497:0:9773:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787574312.227501:0:9773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574312.227503:0:9773:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787574312.227516:0:9773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9773:1874407346712320:0@lo:502: 00000100:00100000:1.0:1787574312.227547:0:9773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.227572:0:9773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031e66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.227572:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346712320 00000100:00100000:0.0:1787574312.227576:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346712320 00000100:00100000:0.0:1787574312.227664:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787574312.227671:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9773:x1874407346712320:12345-0@lo:502: 00000100:00100000:0.0:1787574312.227759:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:9773:x1874407346712320:12345-0@lo:502: Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.227766:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787574312.228716:0:9773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9773:1874407346712320:0@lo:502: 00000020:01000000:1.0:1787574312.228755:0:9773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574312.228762:0:9773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574312.228764:0:9773:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787574312.228768:0:9773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787574312.231027:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787574312.231061:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787574312.231073:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.231084:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574312.231094:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787574312.231097:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca526758000 from 39 10000000:01000000:0.0:1787574312.231100:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574312.231136:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.231145:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.231154:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574312.231175:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346712448:0@lo:101: 00000100:00100000:0.0:1787574312.231232:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.231307:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.231785:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346712448 00000100:00100000:1.0:1787574312.231793:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346712448 00000100:00100000:1.0:1787574312.231850:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787574312.231970:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346712448:12345-0@lo:101: 00010000:00010000:1.0:1787574312.231983:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574312.231996:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb7dfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7df4 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.232018:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb7dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7df4 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.232028:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb7dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7df4 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.232036:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75800, rc 0) 00000100:00100000:1.0:1787574312.232079:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346712448:12345-0@lo:101: Request processed in 220us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.232085:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787574312.232097:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346712448:0@lo:101: 00010000:00010000:0.0:1787574312.232110:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.232136:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574312.232191:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346712576:0@lo:501: 00000100:00100000:0.0:1787574312.232219:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.232267:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.232286:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346712576 00000100:00100000:0.0:1787574312.232290:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346712576 00000100:00100000:0.0:1787574312.232323:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787574312.232330:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346712576:12345-0@lo:501: 00000100:00100000:0.0:1787574312.232448:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346712576:12345-0@lo:501: Request processed in 118us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.232455:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787574312.232501:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346712576:0@lo:501: 00000100:00100000:1.0:1787574312.232527:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346712704:0@lo:503: 00000100:00100000:1.0:1787574312.232564:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.232579:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031e66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574312.232656:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346712704 00000100:00100000:3.0:1787574312.232661:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346712704 00000100:00100000:3.0:1787574312.232727:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787574312.232744:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346712704:12345-0@lo:503: 00000100:00100000:3.0:1787574312.232837:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346712704:12345-0@lo:503: Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574312.232844:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787574312.232981:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346712704:0@lo:503: 00000100:00100000:1.0:1787574312.235047:0:9774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9774:1874407346712832:0@lo:502: 00000100:00100000:1.0:1787574312.235113:0:9774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.235149:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346712832 00000100:00100000:1.0:1787574312.235155:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346712832 00000100:00100000:1.0:1787574312.235199:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787574312.235206:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:9774:x1874407346712832:12345-0@lo:502: 00000100:00100000:1.0:1787574312.235315:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:9774:x1874407346712832:12345-0@lo:502: Request processed in 108us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.235322:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787574312.235368:0:9774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031e6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.235387:0:9774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9774:1874407346712832:0@lo:502: 00000100:00100000:1.0:1787574312.235429:0:9774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9774:1874407346712960:0@lo:502: 00000100:00100000:1.0:1787574312.235459:0:9774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.235478:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346712960 00000100:00100000:1.0:1787574312.235482:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346712960 00000100:00100000:1.0:1787574312.235498:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787574312.235504:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:9774:x1874407346712960:12345-0@lo:502: 00000100:00100000:1.0:1787574312.235561:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:9774:x1874407346712960:12345-0@lo:502: Request processed in 56us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.235568:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787574312.236923:0:9774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031e6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.236946:0:9774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9774:1874407346712960:0@lo:502: 00000040:00080000:1.0:1787574312.236974:0:9774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787574312.237033:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787574312.237054:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787574312.237063:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.237073:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574312.237094:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574312.237096:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca526758000 from 6 10000000:01000000:1.0:1787574312.237099:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574312.237124:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.237131:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.237140:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574312.237154:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346713088:0@lo:101: 00000100:00100000:1.0:1787574312.237187:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.237202:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031e6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.237215:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346713088 00000100:00100000:1.0:1787574312.237219:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346713088 00000100:00100000:1.0:1787574312.237271:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787574312.237279:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346713088:12345-0@lo:101: 00010000:00010000:1.0:1787574312.237288:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574312.237299:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be75400/0xd18a1efeeddb7e09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7e02 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.237318:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be75400/0xd18a1efeeddb7e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e02 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.237327:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be75400/0xd18a1efeeddb7e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e02 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.237346:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75400, rc 0) 00000100:00100000:1.0:1787574312.237385:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346713088:12345-0@lo:101: Request processed in 107us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.237391:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787574312.239320:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346713088:0@lo:101: 00010000:00010000:0.0:1787574312.239341:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.239352:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574312.239427:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346713216:0@lo:256: 00000100:00100000:0.0:1787574312.239474:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.239511:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031e6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.240888:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346713216 00000100:00100000:1.0:1787574312.240896:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346713216 00000100:00100000:1.0:1787574312.240936:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787574312.240945:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346713216:12345-0@lo:256: 20000000:01000000:1.0:1787574312.240962:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787574312.240978:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787574312.240981:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787574312.241070:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346713216:12345-0@lo:256: Request processed in 125us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.259326:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787574312.259418:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346713216:0@lo:256: 10000000:01000000:1.0:1787574312.259482:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787574312.259493:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.259504:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574312.259513:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787574312.259516:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1787574312.259519:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787574312.259551:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.259571:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.259580:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574312.259612:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346713344:0@lo:101: 00000100:00100000:1.0:1787574312.259667:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.259704:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031e6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.260911:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346713344 00000100:00100000:0.0:1787574312.260920:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346713344 00000100:00100000:0.0:1787574312.260966:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787574312.260984:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346713344:12345-0@lo:101: 00010000:00010000:0.0:1787574312.260998:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574312.261011:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7e17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7e10 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.261036:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e10 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.261046:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e10 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.261055:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11e00, rc 0) 00000100:00100000:0.0:1787574312.261102:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346713344:12345-0@lo:101: Request processed in 120us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.261108:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787574312.268021:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346713344:0@lo:101: 00010000:00010000:1.0:1787574312.268049:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.268063:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574312.268139:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346713472:0@lo:501: 00000100:00100000:1.0:1787574312.268194:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.268227:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031e6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.268261:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346713472 00000100:00100000:1.0:1787574312.268267:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346713472 00000100:00100000:1.0:1787574312.268304:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787574312.268313:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346713472:12345-0@lo:501: 00000100:00100000:1.0:1787574312.268425:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346713472:12345-0@lo:501: Request processed in 113us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.268432:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787574312.268478:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346713472:0@lo:501: 00000100:00100000:1.0:1787574312.268502:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346713600:0@lo:503: 00000100:00100000:1.0:1787574312.268536:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.268553:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031e6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.268563:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346713600 00000100:00100000:1.0:1787574312.268567:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346713600 00000100:00100000:1.0:1787574312.268585:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787574312.268591:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346713600:12345-0@lo:503: 00000100:00100000:1.0:1787574312.268678:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346713600:12345-0@lo:503: Request processed in 86us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.268684:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787574312.268721:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346713600:0@lo:503: 00000100:00100000:1.0:1787574312.268910:0:9775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9775:1874407346713728:0@lo:502: 00000100:00100000:1.0:1787574312.268941:0:9775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.268959:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346713728 00000100:00100000:1.0:1787574312.268962:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346713728 00000100:00100000:1.0:1787574312.268982:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787574312.268988:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:9775:x1874407346713728:12345-0@lo:502: 00000100:00100000:1.0:1787574312.269054:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:9775:x1874407346713728:12345-0@lo:502: Request processed in 66us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.269061:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787574312.269090:0:9775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53522f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.269102:0:9775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9775:1874407346713728:0@lo:502: 00000020:01000000:1.0:1787574312.269122:0:9775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787574312.269128:0:9775:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787574312.269134:0:9775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574312.269141:0:9775:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787574312.269146:0:9775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787574312.269150:0:9775:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:1.0:1787574312.269170:0:9775:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787574312.269172:0:9775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574312.269184:0:9775:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ca4032ccd28) 00000020:00000080:1.0:1787574312.269206:0:9775:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1787574312.269211:0:9775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787574312.269307:0:9775:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787574312.269313:0:9775:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787574312.269329:0:9775:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb7e25 00010000:00080000:1.0:1787574312.269358:0:9775:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca403555000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1787574312.269573:0:9775:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1787574312.269684:0:9775:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787574312.269694:0:9775:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787574312.269860:0:9775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574312.270011:0:9775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574312.270134:0:9775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787574312.270218:0:9775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787574312.275549:0:9776:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574312.275556:0:9776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787574312.284815:0:9775:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787574312.284831:0:9775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787574312.284885:0:9775:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787574312.284922:0:9775:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb7e2c 00000100:00080000:0.0:1787574312.284932:0:9775:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787574312.284938:0:9775:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca403555000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574312.284972:0:9775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca403486680 x1874407346713856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574312.285001:0:9775:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787574312.285115:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346713984:0@lo:400: 00000100:00100000:0.0:1787574312.285179:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.285209:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346714496:0@lo:400: 00000100:00100000:0.0:1787574312.285230:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.285278:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346715008:0@lo:400: 00000100:00100000:0.0:1787574312.285301:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.285318:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787574312.285323:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346714112:0@lo:400: 00000100:00100000:0.0:1787574312.285351:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.285369:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346714624:0@lo:400: 00000100:00100000:0.0:1787574312.285391:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.285434:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346714240:0@lo:400: 00000100:00100000:0.0:1787574312.285458:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.285474:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346714752:0@lo:400: 00000100:00100000:0.0:1787574312.285490:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.285505:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787574312.285509:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346714368:0@lo:400: 00000100:00100000:0.0:1787574312.285525:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.285533:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346714880:0@lo:400: 00000100:00100000:0.0:1787574312.285549:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.285571:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346713984 00000100:00100000:0.0:1787574312.285577:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346713984 00000100:00100000:0.0:1787574312.285609:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346714496 00000100:00100000:0.0:1787574312.285612:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346714496 00000100:00100000:0.0:1787574312.285634:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346715008 00000100:00100000:0.0:1787574312.285637:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346715008 00000100:00100000:0.0:1787574312.285647:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346714112 00000100:00100000:0.0:1787574312.285649:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346714112 00000100:00100000:0.0:1787574312.285659:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346714368 00000100:00100000:0.0:1787574312.285661:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346714368 00000100:00100000:0.0:1787574312.285671:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346714880 00000100:00100000:0.0:1787574312.285673:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346714880 00000100:00100000:0.0:1787574312.285687:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574312.285703:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346713984:12345-0@lo:400: 00000100:00100000:0.0:1787574312.285766:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346713984:12345-0@lo:400: Request processed in 64us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.285773:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574312.285788:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787574312.285795:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346714496:12345-0@lo:400: 00000100:00100000:0.0:1787574312.285823:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346714496:12345-0@lo:400: Request processed in 29us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.285830:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787574312.285840:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787574312.285846:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346715008:12345-0@lo:400: 00000100:00100000:0.0:1787574312.285871:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346715008:12345-0@lo:400: Request processed in 26us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.285877:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787574312.285887:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787574312.285892:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346714112:12345-0@lo:400: 00000100:00100000:0.0:1787574312.285916:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346714112:12345-0@lo:400: Request processed in 24us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.285921:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787574312.285931:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787574312.285937:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346714368:12345-0@lo:400: 00000100:00100000:0.0:1787574312.285980:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346714368:12345-0@lo:400: Request processed in 43us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.285987:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787574312.285999:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787574312.286005:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346714880:12345-0@lo:400: 00000100:00100000:0.0:1787574312.286040:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346714880:12345-0@lo:400: Request processed in 36us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.286046:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787574312.286070:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346714624 00000100:00100000:0.0:1787574312.286073:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346714624 00000100:00100000:0.0:1787574312.286094:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346714752 00000100:00100000:0.0:1787574312.286096:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346714752 00000100:00100000:0.0:1787574312.286111:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574312.286116:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346714624:12345-0@lo:400: 00000100:00100000:0.0:1787574312.286141:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346714624:12345-0@lo:400: Request processed in 25us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.286146:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574312.286156:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574312.286161:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346714752:12345-0@lo:400: 00000100:00100000:0.0:1787574312.286184:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346714752:12345-0@lo:400: Request processed in 23us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.286189:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574312.286205:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346714240 00000100:00100000:0.0:1787574312.286208:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346714240 00000100:00100000:0.0:1787574312.286228:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787574312.286234:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346714240:12345-0@lo:400: 00000100:00100000:0.0:1787574312.286277:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346714240:12345-0@lo:400: Request processed in 43us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.286283:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787574312.286295:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574312.286299:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574312.286301:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787574312.286330:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403485f80 x1874407346714368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.286349:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346714368:0@lo:400: 00010000:00080000:0.0:1787574312.286363:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403487480 x1874407346714880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.286371:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346714880:0@lo:400: 00000100:00100000:0.0:1787574312.286381:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346714240:0@lo:400: 00010000:00080000:0.0:1787574312.286390:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403487100 x1874407346714752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.286396:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346714752:0@lo:400: 00010000:00080000:0.0:1787574312.286428:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403484700 x1874407346714112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.286437:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346714112:0@lo:400: 00010000:00080000:0.0:1787574312.286446:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403486d80 x1874407346714624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.286454:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346714624:0@lo:400: 00010000:00080000:0.0:1787574312.286462:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403484380 x1874407346713984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.286470:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346713984:0@lo:400: 00010000:00080000:0.0:1787574312.286477:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403485180 x1874407346714496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.286484:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346714496:0@lo:400: 00010000:00080000:0.0:1787574312.286493:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403487b80 x1874407346715008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.286509:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346715008:0@lo:400: 00000020:01000000:0.0:1787574312.286568:0:9775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574312.286573:0:9775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574312.286576:0:9775:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787574312.286579:0:9775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574312.286582:0:9775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574312.286584:0:9775:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787574312.286587:0:9775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787574312.286589:0:9775:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787574312.286615:0:9775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9775:1874407346715136:0@lo:502: 00000100:00100000:0.0:1787574312.286657:0:9775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.286681:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346715136 00000100:00100000:0.0:1787574312.286685:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346715136 00000100:00100000:0.0:1787574312.286710:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787574312.286716:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:9775:x1874407346715136:12345-0@lo:502: 00000100:00100000:0.0:1787574312.286823:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:9775:x1874407346715136:12345-0@lo:502: Request processed in 106us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.286829:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787574312.286873:0:9775:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bf300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.286887:0:9775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9775:1874407346715136:0@lo:502: 00000020:01000000:0.0:1787574312.286907:0:9775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574312.286911:0:9775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574312.286912:0:9775:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787574312.286915:0:9775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1787574312.286965:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1787574312.286983:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787574312.286992:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.287008:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574312.287019:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787574312.287022:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca5109bd800 from 39 10000000:01000000:0.0:1787574312.287025:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574312.287046:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.287054:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.287062:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574312.287075:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346715264:0@lo:101: 00000100:00100000:0.0:1787574312.287099:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.287114:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bf300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.287128:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346715264 00000100:00100000:0.0:1787574312.287131:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346715264 00000100:00100000:0.0:1787574312.287153:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787574312.287159:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346715264:12345-0@lo:101: 00010000:00010000:0.0:1787574312.287171:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574312.287182:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7e3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7e33 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.287200:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e33 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.287222:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e33 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.287231:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10e00, rc 0) 00000100:00100000:0.0:1787574312.287276:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346715264:12345-0@lo:101: Request processed in 117us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.287281:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787574312.287309:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346715264:0@lo:101: 00010000:00010000:0.0:1787574312.287320:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.287327:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574312.287367:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346715392:0@lo:501: 00000100:00100000:0.0:1787574312.287392:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.287404:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bf300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.287415:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346715392 00000100:00100000:0.0:1787574312.287418:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346715392 00000100:00100000:0.0:1787574312.287439:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787574312.287444:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346715392:12345-0@lo:501: 00000100:00100000:0.0:1787574312.287527:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346715392:12345-0@lo:501: Request processed in 82us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.287533:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787574312.287559:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346715392:0@lo:501: 00000100:00100000:0.0:1787574312.287581:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346715520:0@lo:503: 00000100:00100000:0.0:1787574312.287618:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.287633:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510167d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.287646:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346715520 00000100:00100000:0.0:1787574312.287649:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346715520 00000100:00100000:0.0:1787574312.287672:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787574312.287677:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346715520:12345-0@lo:503: 00000100:00100000:2.0:1787574312.289233:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346713856:0@lo:8: 00000100:00100000:2.0:1787574312.289962:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574312.290036:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346713856 00000100:00100000:2.0:1787574312.290042:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346713856 00000100:00100000:2.0:1787574312.290071:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787574312.290077:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3633:x1874407346713856:12345-0@lo:8: 00010000:00080000:2.0:1787574312.290106:0:8619:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:2.0:1787574312.290134:0:8619:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb7e41 00002000:00100000:2.0:1787574312.290147:0:8619:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ca4033be800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787574312.290151:0:8619:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1787574312.290155:0:8619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787574312.290210:0:8619:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787574312.292550:0:8619:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787574312.292586:0:8619:0:(import.c:65:import_set_state_nolock()) ffff9ca4033ba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574312.292662:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3633:x1874407346713856:12345-0@lo:8: Request processed in 2582us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574312.292672:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787574312.292725:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403486680 x1874407346713856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574312.292747:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574312.292756:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787574312.292763:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787574312.292768:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787574312.292771:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca403555000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787574312.292787:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787574312.292809:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346713856:0@lo:8: 00000004:00080000:2.0:1787574312.292837:0:9776:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787574312.292906:0:9776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 251475665669ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787574312.292912:0:9776:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787574312.293202:0:9777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9777:1874407346715648:0@lo:700: 00000100:00100000:2.0:1787574312.293236:0:9777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.294293:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346715520:0@lo:503: 00000100:00100000:1.0:1787574312.300024:0:9778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9778:1874407346715776:0@lo:502: 00000100:00100000:1.0:1787574312.300120:0:9778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.300176:0:9778:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53522f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574312.300653:0:9777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.300723:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346715520:12345-0@lo:503: Request processed in 57us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.300744:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787574312.300788:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346715776 00000100:00100000:0.0:1787574312.300796:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346715776 00000100:00100000:0.0:1787574312.300846:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787574312.300855:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:9778:x1874407346715776:12345-0@lo:502: 00000100:00100000:0.0:1787574312.300995:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:9778:x1874407346715776:12345-0@lo:502: Request processed in 140us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.301003:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787574312.301126:0:9778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9778:1874407346715776:0@lo:502: 00000100:00100000:0.0:1787574312.301175:0:9778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9778:1874407346715904:0@lo:502: 00000100:00100000:0.0:1787574312.301212:0:9778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.301230:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346715904 00000100:00100000:0.0:1787574312.301234:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346715904 00000100:00100000:0.0:1787574312.301292:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787574312.301299:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:9778:x1874407346715904:12345-0@lo:502: 00000100:00100000:0.0:1787574312.301359:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:9778:x1874407346715904:12345-0@lo:502: Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.301365:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787574312.302645:0:9778:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510167780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.302672:0:9778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9778:1874407346715904:0@lo:502: 00000040:00080000:0.0:1787574312.302702:0:9778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:3.0:1787574312.303855:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346715648 00000100:00100000:3.0:1787574312.303872:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346715648 00000100:00100000:3.0:1787574312.303941:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574312.303951:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9777:x1874407346715648:12345-0@lo:700: 00000100:00100000:3.0:1787574312.303994:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8433:1874407346716032:0@lo:700: 00000100:00100000:3.0:1787574312.304053:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574312.304076:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574312.304095:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346716032 00000100:00100000:3.0:1787574312.304098:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346716032 00000100:00100000:3.0:1787574312.304122:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574312.304129:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8433:x1874407346716032:12345-0@lo:700: 00000020:01000000:1.0:1787574312.304136:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787574312.304161:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787574312.304171:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.304191:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574312.304200:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574312.304203:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca5109bd800 from 6 10000000:01000000:1.0:1787574312.304205:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574312.304227:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.304235:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.304256:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574312.304267:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346716160:0@lo:101: 00000100:00100000:1.0:1787574312.304298:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.304318:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53522ff00 going to sleep for 11 seconds 00000004:00080000:1.0:1787574312.306070:0:7440:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00080000:0.0:1787574312.310670:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574312.310717:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346716160 00000100:00100000:0.0:1787574312.310728:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346716160 00000100:00100000:0.0:1787574312.310803:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787574312.310813:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346716160:12345-0@lo:101: 00010000:00010000:0.0:1787574312.310829:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574312.310848:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca535c10c00/0xd18a1efeeddb7e4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7e48 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.310875:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c10c00/0xd18a1efeeddb7e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e48 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.310886:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca535c10c00/0xd18a1efeeddb7e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e48 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.310906:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10c00, rc 0) 00000100:00100000:0.0:1787574312.310986:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346716160:12345-0@lo:101: Request processed in 175us (6687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.310995:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787574312.311048:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346716160:0@lo:101: 00010000:00010000:1.0:1787574312.311079:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.311103:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574312.311192:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346716288:0@lo:256: 00000100:00100000:1.0:1787574312.311297:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.311360:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53522ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.313456:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346716288 00000100:00100000:0.0:1787574312.313466:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346716288 00000100:00100000:0.0:1787574312.313516:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787574312.313526:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346716288:12345-0@lo:256: 20000000:01000000:0.0:1787574312.313547:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787574312.313564:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787574312.313567:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787574312.313689:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346716288:12345-0@lo:256: Request processed in 164us (2390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.313696:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787574312.313757:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346716288:0@lo:256: 10000000:01000000:0.0:1787574312.313827:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787574312.313837:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.313848:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574312.313867:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787574312.313870:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787574312.313873:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787574312.313916:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.313924:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.313933:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574312.313951:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346716416:0@lo:101: 00000100:00100000:0.0:1787574312.313986:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.314021:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031eff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.314226:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346716416 00000100:00100000:1.0:1787574312.314263:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346716416 00000100:00100000:1.0:1787574312.314319:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787574312.314330:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346716416:12345-0@lo:101: 00010000:00010000:1.0:1787574312.314345:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574312.314364:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7e5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7e56 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.314407:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e56 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.314420:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e56 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574312.314431:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74000, rc 0) 00000100:00100000:1.0:1787574312.314503:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346716416:12345-0@lo:101: Request processed in 175us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.314509:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787574312.324001:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346716416:0@lo:101: 00010000:00010000:0.0:1787574312.324030:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574312.324064:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574312.324158:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346716544:0@lo:501: 00000100:00100000:0.0:1787574312.324222:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.324327:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031eff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.324400:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346716544 00000100:00100000:1.0:1787574312.324415:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346716544 00000100:00100000:1.0:1787574312.324492:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787574312.324505:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346716544:12345-0@lo:501: 00000100:00100000:1.0:1787574312.324720:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346716544:12345-0@lo:501: Request processed in 218us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.324730:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 40000000:02000000:1.0:1787574312.329662:0:6516:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1787574312.330921:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346716544:0@lo:501: 00000100:00100000:0.0:1787574312.330988:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346716672:0@lo:503: 00000100:00100000:0.0:1787574312.331069:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.331119:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031eff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574312.331133:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346716672 00000100:00100000:2.0:1787574312.331141:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346716672 00000100:00100000:2.0:1787574312.331206:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787574312.331217:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346716672:12345-0@lo:503: 00000100:00100000:2.0:1787574312.331360:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346716672:12345-0@lo:503: Request processed in 144us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574312.331367:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787574312.331986:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346716672:0@lo:503: 00000100:00100000:3.0:1787574312.363155:0:9779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9779:1874407346716800:0@lo:502: 00000100:00100000:3.0:1787574312.363272:0:9779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574312.363314:0:9779:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574312.370920:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346716800 00000100:00100000:2.0:1787574312.370935:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346716800 00000100:00100000:2.0:1787574312.371007:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787574312.371018:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:9779:x1874407346716800:12345-0@lo:502: 00000100:00100000:2.0:1787574312.371199:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:9779:x1874407346716800:12345-0@lo:502: Request processed in 182us (7935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574312.371207:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787574312.375945:0:9779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9779:1874407346716800:0@lo:502: 00000020:01000000:3.0:1787574312.375992:0:9779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787574312.376000:0:9779:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787574312.376009:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574312.376011:0:9779:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787574312.376016:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787574312.376020:0:9779:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:3.0:1787574312.376046:0:9779:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787574312.376049:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787574312.376065:0:9779:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ca4024c8000) 00000020:00000080:3.0:1787574312.376089:0:9779:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1787574312.376094:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787574312.376196:0:9779:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787574312.376202:0:9779:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787574312.376209:0:9779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb7e6b 00010000:00080000:3.0:1787574312.376237:0:9779:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca403185000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1787574312.376486:0:9779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1787574312.376628:0:9779:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787574312.376641:0:9779:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787574312.376827:0:9779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574312.376946:0:9779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574312.377083:0:9779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787574312.377173:0:9779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:1.0:1787574312.378077:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8433:x1874407346716032:12345-0@lo:700: Request processed in 73944us (74018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.378098:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787574312.379039:0:8433:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8e680 x1874407346716032/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787574328 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574312.379055:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8433:1874407346716032:0@lo:700: 40000000:02000000:2.0:1787574312.379066:0:8433:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:1.0:1787574312.384323:0:9780:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574312.384331:0:9780:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787574312.396628:0:9779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787574312.396645:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787574312.396690:0:9779:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787574312.396714:0:9779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb7e72 00000100:00080000:3.0:1787574312.396724:0:9779:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574312.396730:0:9779:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca403185000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574312.396777:0:9779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca504599f80 x1874407346716928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574312.396799:0:9779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787574312.396862:0:9779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574312.396866:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574312.396868:0:9779:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787574312.396871:0:9779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574312.396874:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574312.396876:0:9779:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787574312.396879:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787574312.396881:0:9779:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787574312.396930:0:9779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9779:1874407346717056:0@lo:502: 00000100:00100000:3.0:1787574312.397007:0:9779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574312.397043:0:9779:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574312.397629:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346716928:0@lo:8: 00000100:00100000:3.0:1787574312.397667:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574312.397704:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346716928 00000100:00100000:3.0:1787574312.397711:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346716928 00000100:00100000:3.0:1787574312.397755:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787574312.397762:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1874407346716928:12345-0@lo:8: 00010000:00080000:3.0:1787574312.397797:0:8423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:3.0:1787574312.397820:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb7e79 00002000:00100000:3.0:1787574312.397834:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ca403185800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787574312.397838:0:8423:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787574312.397841:0:8423:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787574312.398075:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787574312.398098:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9ca403184800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574312.398155:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1874407346716928:12345-0@lo:8: Request processed in 391us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574312.398162:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787574312.398316:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504599f80 x1874407346716928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574312.398327:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787574312.398335:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787574312.398342:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787574312.398346:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787574312.398348:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca403185000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787574312.398363:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787574312.398369:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346716928:0@lo:8: 00000004:00080000:1.0:1787574312.398393:0:9780:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787574312.398445:0:9780:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 251581204394ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787574312.398452:0:9780:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787574312.399759:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346717056 00000100:00100000:1.0:1787574312.399768:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346717056 00000100:00100000:1.0:1787574312.399809:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787574312.399818:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:9779:x1874407346717056:12345-0@lo:502: 00000100:00100000:1.0:1787574312.399961:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:9779:x1874407346717056:12345-0@lo:502: Request processed in 143us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.399968:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787574312.400772:0:9779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:9779:1874407346717056:0@lo:502: 00000020:01000000:3.0:1787574312.400807:0:9779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574312.400814:0:9779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574312.400816:0:9779:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787574312.400823:0:9779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1787574312.407409:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1787574312.407444:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787574312.407462:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574312.407474:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574312.407483:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787574312.407486:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ca5050d4d28 from 1 10000000:01000000:2.0:1787574312.407488:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787574312.407520:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574312.407528:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574312.407538:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574312.407559:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346717184:0@lo:101: 00000100:00100000:2.0:1787574312.410840:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574312.410888:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574312.410925:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346717184 00000100:00100000:2.0:1787574312.410934:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346717184 00000100:00100000:2.0:1787574312.410985:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787574312.410995:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346717184:12345-0@lo:101: 00010000:00010000:2.0:1787574312.411010:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574312.411027:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7e87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7e80 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574312.411054:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e80 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574312.411074:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e80 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574312.411083:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83600, rc 0) 00000100:00100000:2.0:1787574312.411124:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346717184:12345-0@lo:101: Request processed in 131us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574312.411131:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787574312.411178:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346717184:0@lo:101: 00010000:00010000:2.0:1787574312.411193:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574312.411202:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574312.411283:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346717312:0@lo:501: 00000100:00100000:2.0:1787574312.411311:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574312.411325:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574312.411336:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346717312 00000100:00100000:2.0:1787574312.411339:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346717312 00000100:00100000:2.0:1787574312.411354:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787574312.411360:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346717312:12345-0@lo:501: 00000100:00100000:2.0:1787574312.411446:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346717312:12345-0@lo:501: Request processed in 85us (133us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574312.411453:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787574312.411480:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346717312:0@lo:501: 10000000:01000000:2.0:1787574312.411503:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787574312.411516:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574312.411523:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787574312.420159:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787574312.420170:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787574312.423628:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9777:x1874407346715648:12345-0@lo:700: Request processed in 119670us (130383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574312.423643:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787574312.425082:0:9777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5349ff480 x1874407346715648/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787574328 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574312.425099:0:9777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9777:1874407346715648:0@lo:700: 00000004:00080000:0.0:1787574312.425559:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787574312.426143:0:9781:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787574312.426168:0:9781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403596a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9781:1874407346717568:0@lo:7: 00000100:00100000:3.0:1787574312.426224:0:9781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574312.426268:0:9781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5185a90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574312.426322:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574312.426336:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346717440:0@lo:13: 00000100:00100000:1.0:1787574312.426366:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.428007:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346717568 00000100:00100000:1.0:1787574312.428023:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346717568 00000100:00100000:1.0:1787574312.428089:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574312.428098:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9781:x1874407346717568:12345-0@lo:7: 00000100:00100000:3.0:1787574312.428508:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346717440 00000100:00100000:3.0:1787574312.428513:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346717440 00000100:00100000:3.0:1787574312.428549:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787574312.428556:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346717440:12345-0@lo:13: 00002000:00000024:3.0:1787574312.428572:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:3.0:1787574312.428784:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346717440:12345-0@lo:13: Request processed in 94us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574312.428792:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787574312.429507:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787574312.429998:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403594380 x1874407346717440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.430019:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346717440:0@lo:13: 00002000:00080000:1.0:1787574312.445675:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787574312.445683:0:8426:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787574312.445792:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9781:x1874407346717568:12345-0@lo:7: Request processed in 17690us (19563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.445804:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787574312.450021:0:9781:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403596a00 x1874407346717568/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787574328 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574312.450041:0:9781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403596a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9781:1874407346717568:0@lo:7: 00000004:00080000:2.0:1787574312.450057:0:9781:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787574312.450100:0:9781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9781:1874407346717696:0@lo:5: 00000100:00100000:2.0:1787574312.450160:0:9781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574312.450201:0:9781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574312.453824:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346717696 00000100:00100000:3.0:1787574312.453851:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346717696 00000100:00100000:3.0:1787574312.453919:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574312.453929:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9781:x1874407346717696:12345-0@lo:5: 00002000:00080000:3.0:1787574312.453960:0:8423:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787574312.453964:0:8423:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787574312.454370:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9781:x1874407346717696:12345-0@lo:5: Request processed in 443us (4209us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787574312.454378:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787574312.458158:0:9781:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5349ffb80 x1874407346717696/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574328 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574312.458180:0:9781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9781:1874407346717696:0@lo:5: 00000004:00080000:3.0:1787574312.458195:0:9781:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787574312.458495:0:9781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9781:1874407346717824:0@lo:700: 00000100:00100000:0.0:1787574312.465045:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346717952:0@lo:13: 00000100:00100000:0.0:1787574312.465119:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787574312.465185:0:9777:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787574312.465208:0:9777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9777:1874407346718080:0@lo:7: 00000100:00100000:0.0:1787574312.465233:0:9777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.465273:0:9777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5078b4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574312.465328:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346717952 00000100:00100000:3.0:1787574312.465335:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346717952 00000100:00100000:3.0:1787574312.465388:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787574312.465406:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346717952:12345-0@lo:13: 00002000:00000024:3.0:1787574312.465426:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:3.0:1787574312.465474:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346717952:12345-0@lo:13: Request processed in 77us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574312.465493:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787574312.465516:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346718080 00000100:00100000:3.0:1787574312.465520:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346718080 00000100:00100000:3.0:1787574312.465541:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574312.465547:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9777:x1874407346718080:12345-0@lo:7: 00000100:00100000:2.0:1787574312.467563:0:9781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574312.467607:0:9781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5185a90c0 going to sleep for 11 seconds 00010000:00080000:0.0:1787574312.469342:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40351e300 x1874407346717952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.469380:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346717952:0@lo:13: 00000100:00100000:2.0:1787574312.479141:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346717824 00000100:00100000:2.0:1787574312.479153:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346717824 00000100:00100000:2.0:1787574312.479207:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574312.479217:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9781:x1874407346717824:12345-0@lo:700: 00002000:00080000:3.0:1787574312.490680:0:8619:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787574312.490689:0:8619:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787574312.490791:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9777:x1874407346718080:12345-0@lo:7: Request processed in 25239us (25553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574312.490802:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787574312.491802:0:9777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40351f800 x1874407346718080/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787574328 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574312.491817:0:9777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9777:1874407346718080:0@lo:7: 00000004:00080000:1.0:1787574312.491831:0:9777:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787574312.491881:0:9777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d51880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9777:1874407346718208:0@lo:5: 00000100:00100000:1.0:1787574312.491931:0:9777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574312.491963:0:9777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031e66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.493794:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346718208 00000100:00100000:0.0:1787574312.493805:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346718208 00000100:00100000:0.0:1787574312.493866:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787574312.493875:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9777:x1874407346718208:12345-0@lo:5: 00002000:00080000:0.0:1787574312.493915:0:8423:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1787574312.493969:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9777:x1874407346718208:12345-0@lo:5: Request processed in 95us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.493975:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787574312.494014:0:9777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d51880 x1874407346718208/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574328 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.494026:0:9777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d51880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9777:1874407346718208:0@lo:5: 00000004:00080000:0.0:1787574312.494035:0:9777:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787574312.494066:0:9777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9777:1874407346718336:0@lo:5: 00000100:00100000:0.0:1787574312.494092:0:9777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.494109:0:9777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5078b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.494122:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346718336 00000100:00100000:0.0:1787574312.494126:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346718336 00000100:00100000:0.0:1787574312.494151:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574312.494158:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9777:x1874407346718336:12345-0@lo:5: 00002000:00080000:0.0:1787574312.494179:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1787574312.510229:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9777:x1874407346718336:12345-0@lo:5: Request processed in 16064us (16129us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787574312.510262:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787574312.510320:0:9777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40351e300 x1874407346718336/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574328 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574312.510347:0:9777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9777:1874407346718336:0@lo:5: 00000004:00080000:0.0:1787574312.510363:0:9777:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787574312.510402:0:9777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9777:1874407346718464:0@lo:900: 00000100:00100000:0.0:1787574312.510437:0:9777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.510462:0:9777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5078b4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574312.512327:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346718464 00000100:00100000:3.0:1787574312.512340:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346718464 00000100:00100000:3.0:1787574312.512413:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574312.512422:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9777:x1874407346718464:12345-0@lo:900: 00000100:00100000:3.0:1787574312.512499:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9777:x1874407346718464:12345-0@lo:900: Request processed in 77us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574312.512506:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787574312.512866:0:9777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40351c700 x1874407346718464/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787574328 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574312.512881:0:9777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9777:1874407346718464:0@lo:900: 00000001:00080000:3.0:1787574312.518172:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1787574312.518364:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9781:x1874407346717824:12345-0@lo:700: Request processed in 39144us (50800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574312.518376:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787574312.518653:0:9781:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403595880 x1874407346717824/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787574328 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574312.518666:0:9781:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787574312.518682:0:9781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9781:1874407346717824:0@lo:700: 00000004:02000040:3.0:1787574312.534584:0:9781:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1787574312.537297:0:9781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9781:1874407346718592:0@lo:5: 00000100:00100000:3.0:1787574312.537360:0:9781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574312.537398:0:9781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51e9a1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574312.540870:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346718592 00000100:00100000:0.0:1787574312.540885:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346718592 00000100:00100000:0.0:1787574312.540966:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787574312.540977:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9781:x1874407346718592:12345-0@lo:5: 00002000:00080000:0.0:1787574312.560108:0:8423:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787574312.560134:0:8423:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1787574312.565385:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9781:x1874407346718592:12345-0@lo:5: Request processed in 24401us (28015us total) trans 4294967299 rc 0/0 00010000:00080000:3.0:1787574312.565645:0:9781:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403595880 x1874407346718592/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574328 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574312.565665:0:9781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9781:1874407346718592:0@lo:5: 00000004:00080000:3.0:1787574312.565680:0:9781:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:1.0:1787574312.567747:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787574312.638489:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574312.702739:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574312.702767:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346718720:0@lo:41: 00000100:00100000:3.0:1787574312.702837:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574312.703025:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346718720 00000100:00100000:0.0:1787574312.703033:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346718720 00000100:00100000:0.0:1787574312.703082:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787574312.703092:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346718720:12345-0@lo:41: 00000004:00000024:0.0:1787574312.703125:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787574312.703182:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346718720:12345-0@lo:41: Request processed in 91us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574312.703189:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787574312.705085:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346718720:0@lo:41: 00010000:00010000:3.0:1787574313.655369:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574314.674231:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787574315.079199:0:9875:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787574315.697748:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574315.762441:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346718848:0@lo:13: 00000100:00100000:1.0:1787574315.762533:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574315.762810:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346718848 00000100:00100000:3.0:1787574315.762819:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346718848 00000100:00100000:3.0:1787574315.762877:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787574315.762886:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346718848:12345-0@lo:13: 00002000:00000024:3.0:1787574315.762911:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574315.762952:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346718848:12345-0@lo:13: Request processed in 68us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574315.762959:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787574315.762994:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d52a00 x1874407346718848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574315.763010:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346718848:0@lo:13: 00000100:00100000:3.0:1787574315.763289:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574315.763299:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346718976:0@lo:13: 00000100:00100000:3.0:1787574315.763328:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574315.763361:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346718976 00000100:00100000:3.0:1787574315.763373:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346718976 00000100:00100000:3.0:1787574315.763400:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787574315.763414:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346718976:12345-0@lo:13: 00002000:00000024:3.0:1787574315.763426:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574315.763457:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346718976:12345-0@lo:13: Request processed in 44us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574315.763463:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787574315.763499:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403595500 x1874407346718976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574315.763512:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346718976:0@lo:13: 00000100:00080000:1.0:1787574315.764582:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1787574316.704806:0:9928:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787574316.705022:0:9928:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574316.722038:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574317.302617:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346719104:0@lo:41: 00000100:00100000:1.0:1787574317.302708:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.302974:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346719104 00000100:00100000:0.0:1787574317.302984:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346719104 00000100:00100000:0.0:1787574317.303044:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787574317.303054:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346719104:12345-0@lo:41: 00000004:00000024:0.0:1787574317.303091:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787574317.303162:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346719104:12345-0@lo:41: Request processed in 109us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.303169:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787574317.303215:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346719104:0@lo:41: 00010000:00010000:3.0:1787574317.750295:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574317.810256:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346719232:0@lo:400: 00000100:00100000:0.0:1787574317.810334:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810390:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346719744:0@lo:400: 00000100:00100000:0.0:1787574317.810413:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810430:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346720256:0@lo:400: 00000100:00100000:0.0:1787574317.810446:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810467:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787574317.810472:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346719616:0@lo:400: 00000100:00100000:0.0:1787574317.810493:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810506:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346720128:0@lo:400: 00000100:00100000:0.0:1787574317.810524:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810539:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346720640:0@lo:400: 00000100:00100000:0.0:1787574317.810556:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810588:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346719488:0@lo:400: 00000100:00100000:0.0:1787574317.810611:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810629:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346720000:0@lo:400: 00000100:00100000:0.0:1787574317.810662:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810676:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346720512:0@lo:400: 00000100:00100000:0.0:1787574317.810707:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810723:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787574317.810728:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346719360:0@lo:400: 00000100:00100000:0.0:1787574317.810761:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810779:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346719872:0@lo:400: 00000100:00100000:0.0:1787574317.810799:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810808:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346720384:0@lo:400: 00000100:00100000:0.0:1787574317.810824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.810848:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346719232 00000100:00100000:0.0:1787574317.810856:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346719232 00000100:00100000:0.0:1787574317.810917:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787574317.810927:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346719232:12345-0@lo:400: 00000100:00100000:0.0:1787574317.810978:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346719232:12345-0@lo:400: Request processed in 53us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.810984:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787574317.811017:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346719744 00000100:00100000:0.0:1787574317.811020:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346719744 00000100:00100000:0.0:1787574317.811044:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346720256 00000100:00100000:0.0:1787574317.811046:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346720256 00000100:00100000:0.0:1787574317.811056:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346719488 00000100:00100000:0.0:1787574317.811059:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346719488 00000100:00100000:0.0:1787574317.811066:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346719360 00000100:00100000:0.0:1787574317.811068:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346719360 00000100:00100000:0.0:1787574317.811078:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346719872 00000100:00100000:0.0:1787574317.811081:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346719872 00000100:00100000:0.0:1787574317.811107:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346720384 00000100:00100000:0.0:1787574317.811110:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346720384 00000100:00100000:0.0:1787574317.811124:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787574317.811130:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346719744:12345-0@lo:400: 00000100:00100000:0.0:1787574317.811162:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346719744:12345-0@lo:400: Request processed in 33us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.811168:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787574317.811187:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787574317.811193:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346720256:12345-0@lo:400: 00000100:00100000:0.0:1787574317.811219:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346720256:12345-0@lo:400: Request processed in 27us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.811225:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787574317.811236:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787574317.811264:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346719488:12345-0@lo:400: 00000100:00100000:0.0:1787574317.811292:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346719488:12345-0@lo:400: Request processed in 30us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.811297:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787574317.811307:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787574317.811314:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346719360:12345-0@lo:400: 00000100:00100000:0.0:1787574317.811339:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346719360:12345-0@lo:400: Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.811344:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787574317.811354:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787574317.811360:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346719872:12345-0@lo:400: 00000100:00100000:0.0:1787574317.811384:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346719872:12345-0@lo:400: Request processed in 25us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.811389:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787574317.811401:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787574317.811407:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346720384:12345-0@lo:400: 00000100:00100000:0.0:1787574317.811432:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346720384:12345-0@lo:400: Request processed in 26us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.811437:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787574317.811459:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346719616 00000100:00100000:0.0:1787574317.811471:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346719616 00000100:00100000:0.0:1787574317.811497:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787574317.811503:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346719616:12345-0@lo:400: 00000100:00100000:0.0:1787574317.811535:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346719616:12345-0@lo:400: Request processed in 32us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.811541:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787574317.811558:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346720128 00000100:00100000:0.0:1787574317.811562:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346720128 00000100:00100000:0.0:1787574317.811581:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346720640 00000100:00100000:0.0:1787574317.811584:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346720640 00000100:00100000:0.0:1787574317.811595:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346720000 00000100:00100000:0.0:1787574317.811597:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346720000 00000100:00100000:0.0:1787574317.811608:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346720512 00000100:00100000:0.0:1787574317.811610:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346720512 00000100:00100000:0.0:1787574317.811622:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574317.811628:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346720128:12345-0@lo:400: 00000100:00100000:0.0:1787574317.811670:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346720128:12345-0@lo:400: Request processed in 41us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.811676:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574317.811700:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574317.811706:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346720640:12345-0@lo:400: 00000100:00100000:0.0:1787574317.811734:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346720640:12345-0@lo:400: Request processed in 28us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.811739:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574317.811750:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574317.811755:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346720000:12345-0@lo:400: 00000100:00100000:0.0:1787574317.811782:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346720000:12345-0@lo:400: Request processed in 27us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.811797:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574317.811810:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787574317.811816:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346720512:12345-0@lo:400: 00000100:00100000:0.0:1787574317.811843:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346720512:12345-0@lo:400: Request processed in 27us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.811848:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787574317.811901:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d52a00 x1874407346719360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574317.811916:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346719360:0@lo:400: 00010000:00080000:0.0:1787574317.811928:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504599f80 x1874407346719872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574317.811936:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346719872:0@lo:400: 00010000:00080000:0.0:1787574317.811946:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d45f80 x1874407346720384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574317.811954:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346720384:0@lo:400: 00010000:00080000:0.0:1787574317.811965:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d51880 x1874407346719488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574317.811973:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346719488:0@lo:400: 00010000:00080000:0.0:1787574317.811983:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5350e5f80 x1874407346720000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574317.811992:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346720000:0@lo:400: 00010000:00080000:0.0:1787574317.812002:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d45880 x1874407346720512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574317.812019:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346720512:0@lo:400: 00000100:00100000:0.0:1787574317.812070:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346719616:0@lo:400: 00010000:00080000:0.0:1787574317.812082:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d44700 x1874407346720128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574317.812090:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346720128:0@lo:400: 00010000:00080000:0.0:1787574317.812100:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d45c00 x1874407346720640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574317.812108:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346720640:0@lo:400: 00000100:00100000:0.0:1787574317.812117:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346719232:0@lo:400: 00010000:00080000:0.0:1787574317.812127:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d53100 x1874407346719744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574317.812134:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346719744:0@lo:400: 00010000:00080000:0.0:1787574317.812144:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d46a00 x1874407346720256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574317.812152:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346720256:0@lo:400: 00000100:00100000:3.0:1787574317.812783:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574317.812797:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346720768:0@lo:13: 00000100:00100000:3.0:1787574317.812845:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574317.812883:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346720768 00000100:00100000:3.0:1787574317.812888:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346720768 00000100:00100000:3.0:1787574317.814909:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574317.814925:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346720768:12345-0@lo:13: 00002000:00000024:3.0:1787574317.814962:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787574317.816159:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574317.816168:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574317.816173:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574317.816175:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574317.816194:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574317.816213:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346720896:0@lo:13: 00000100:00100000:1.0:1787574317.816300:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574317.816359:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346720768:12345-0@lo:13: Request processed in 130us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574317.816371:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574317.816397:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346720896 00000100:00100000:3.0:1787574317.816407:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346720896 00000100:00100000:3.0:1787574317.816441:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574317.816448:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346720896:12345-0@lo:13: 00002000:00000024:3.0:1787574317.816477:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574317.816529:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346720896:12345-0@lo:13: Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574317.816545:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787574317.816617:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403595500 x1874407346720768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574317.816641:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346720768:0@lo:13: 00010000:00080000:1.0:1787574317.817316:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d47480 x1874407346720896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574317.817333:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346720896:0@lo:13: 00000100:00100000:0.0:1787574317.823112:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346721024:0@lo:41: 00000100:00100000:0.0:1787574317.823175:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574317.823217:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346721024 00000100:00100000:0.0:1787574317.823225:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346721024 00000100:00100000:0.0:1787574317.823291:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574317.823417:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346721024:12345-0@lo:41: 00000004:00000024:0.0:1787574317.823455:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787574317.823508:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346721024:12345-0@lo:41: Request processed in 208us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574317.823515:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574317.823566:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346721024:0@lo:41: 00000001:00080000:1.0:1787574317.831217:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1787574317.831234:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787574318.788782:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574319.793711:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787574320.254971:0:10029:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574320.255233:0:10029:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574320.817492:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574320.881393:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574320.881418:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346721152:0@lo:13: 00000100:00100000:0.0:1787574320.881617:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574320.881628:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346721280:0@lo:13: 00000100:00100000:0.0:1787574320.881703:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574320.881868:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346721280 00000100:00100000:1.0:1787574320.881877:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346721280 00000100:00100000:1.0:1787574320.881939:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574320.881950:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346721280:12345-0@lo:13: 00002000:00000024:1.0:1787574320.881979:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574320.882025:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346721280:12345-0@lo:13: Request processed in 77us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574320.882032:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787574320.882088:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574320.882114:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d47480 x1874407346721280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574320.882133:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346721280:0@lo:13: 00000100:00100000:3.0:1787574320.882286:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574320.882396:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346721152 00000100:00100000:3.0:1787574320.882402:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346721152 00000100:00100000:3.0:1787574320.882533:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574320.882540:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346721152:12345-0@lo:13: 00002000:00000024:3.0:1787574320.882551:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574320.882584:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346721152:12345-0@lo:13: Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574320.882590:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787574320.882618:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403595500 x1874407346721152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574320.882631:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346721152:0@lo:13: 00000100:00080000:1.0:1787574320.885062:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1787574321.145402:0:10077:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787574321.145415:0:10077:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1787574321.844592:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574321.984364:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574321.984510:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323598976 00000100:00100000:2.0:1787574321.984525:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323598976 00000100:00100000:2.0:1787574321.984601:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 181 00000100:00100000:2.0:1787574321.984612:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1874407323598976:12345-192.168.202.40@tcp:250: 00010000:00080000:2.0:1787574321.984656:0:6504:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 24bb2d4e-8223-4dd7-b95b-94a02d249511@192.168.202.40@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:2.0:1787574321.984693:0:6504:0:(genops.c:1385:class_connect()) connect: client 24bb2d4e-8223-4dd7-b95b-94a02d249511, cookie 0xd18a1efeeddb7e8e 00000100:00080000:2.0:1787574321.984876:0:6504:0:(import.c:65:import_set_state_nolock()) ffff9ca4033bf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574321.984965:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+5:2401:x1874407323598976:12345-192.168.202.40@tcp:250: Request processed in 352us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574321.984974:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 181 00000100:00100000:1.0:1787574322.021706:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574322.021838:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323599104 00000100:00100000:2.0:1787574322.021864:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323599104 00000100:00100000:2.0:1787574322.021939:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:2.0:1787574322.021952:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+5:6165:x1874407323599104:12345-192.168.202.40@tcp:101: 00010000:00010000:2.0:1787574322.021975:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574322.021999:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7e95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b4fa expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574322.022035:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b4fa expref: 6 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574322.022048:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b4fa expref: 6 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574322.022058:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82200, rc 0) 00000100:00100000:2.0:1787574322.022134:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+6:6165:x1874407323599104:12345-192.168.202.40@tcp:101: Request processed in 184us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574322.022142:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:3.0:1787574322.028793:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574322.029065:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323599232 00000100:00100000:0.0:1787574322.029081:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323599232 00000100:00100000:0.0:1787574322.029162:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 183 00000100:00100000:0.0:1787574322.029175:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+6:6165:x1874407323599232:12345-192.168.202.40@tcp:501: 00000100:00100000:0.0:1787574322.029395:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+6:6165:x1874407323599232:12345-192.168.202.40@tcp:501: Request processed in 222us (619us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787574322.029405:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 183 00000100:00100000:0.0:1787574322.031779:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574322.032090:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323599360 00000100:00100000:2.0:1787574322.032103:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323599360 00000100:00100000:2.0:1787574322.032172:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:2.0:1787574322.032185:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+6:6165:x1874407323599360:12345-192.168.202.40@tcp:101: 00010000:00010000:2.0:1787574322.032207:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574322.032232:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb7e9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b501 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574322.032330:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb7e9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b501 expref: 7 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574322.032343:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb7e9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b501 expref: 7 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574322.032356:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82000, rc 0) 00000100:00100000:2.0:1787574322.032420:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+7:6165:x1874407323599360:12345-192.168.202.40@tcp:101: Request processed in 237us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574322.032428:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:1.0:1787574322.035575:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574322.037141:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323599488 00000100:00100000:2.0:1787574322.037161:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323599488 00000100:00100000:0.0:1787574322.037393:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 185 00000100:00100000:0.0:1787574322.037411:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+7:6165:x1874407323599488:12345-192.168.202.40@tcp:501: 00000100:00100000:0.0:1787574322.037661:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:6165:x1874407323599488:12345-192.168.202.40@tcp:501: Request processed in 256us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574322.037691:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 185 00000100:00100000:3.0:1787574322.041364:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574322.042514:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323599616 00000100:00100000:1.0:1787574322.042539:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323599616 00000100:00100000:1.0:1787574322.042621:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:1.0:1787574322.042633:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:6165:x1874407323599616:12345-192.168.202.40@tcp:503: 00000100:00100000:1.0:1787574322.042868:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:6165:x1874407323599616:12345-192.168.202.40@tcp:503: Request processed in 236us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574322.042876:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:1.0:1787574322.050929:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574322.051142:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323599744 00000100:00100000:2.0:1787574322.051156:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323599744 00000100:00100000:2.0:1787574322.051224:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00100000:2.0:1787574322.051234:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:6183:x1874407323599744:12345-192.168.202.40@tcp:502: 00000100:00100000:2.0:1787574322.051489:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:6183:x1874407323599744:12345-192.168.202.40@tcp:502: Request processed in 256us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574322.051498:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00100000:2.0:1787574322.119846:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574322.121114:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323599872 00000100:00100000:0.0:1787574322.121131:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323599872 00000100:00100000:0.0:1787574322.121212:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:0.0:1787574322.121223:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:6183:x1874407323599872:12345-192.168.202.40@tcp:502: 00000100:00100000:0.0:1787574322.121535:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:6183:x1874407323599872:12345-192.168.202.40@tcp:502: Request processed in 311us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574322.121544:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:3.0:1787574322.153508:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574322.155798:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323600000 00000100:00100000:1.0:1787574322.155826:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323600000 00000100:00100000:1.0:1787574322.155929:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:1.0:1787574322.155943:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:6165:x1874407323600000:12345-192.168.202.40@tcp:101: 00010000:00010000:1.0:1787574322.155965:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574322.156506:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb7ea3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b532 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574322.157154:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb7ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b532 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574322.157170:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb7ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b532 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574322.157183:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75a00, rc 0) 00000100:00100000:1.0:1787574322.157368:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6165:x1874407323600000:12345-192.168.202.40@tcp:101: Request processed in 1427us (3874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574322.157377:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:1.0:1787574322.197881:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574322.198032:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323600128 00000100:00100000:2.0:1787574322.198048:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323600128 00000100:00100000:2.0:1787574322.198129:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:2.0:1787574322.198144:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6165:x1874407323600128:12345-192.168.202.40@tcp:256: 20000000:01000000:2.0:1787574322.198179:0:6501:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787574322.198202:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787574322.198207:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787574322.198210:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787574322.198213:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787574322.198215:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787574322.210050:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6165:x1874407323600128:12345-192.168.202.40@tcp:256: Request processed in 11892us (12166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574322.210071:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:3.0:1787574322.224538:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574322.227297:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323600256 00000100:00100000:1.0:1787574322.227320:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323600256 00000100:00100000:1.0:1787574322.227404:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00100000:1.0:1787574322.227418:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6165:x1874407323600256:12345-192.168.202.40@tcp:101: 00010000:00010000:1.0:1787574322.227440:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574322.227466:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74e00/0xd18a1efeeddb7eaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b539 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574322.227504:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74e00/0xd18a1efeeddb7eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b539 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574322.227517:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74e00/0xd18a1efeeddb7eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b539 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574322.227529:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74e00, rc 0) 00000100:00100000:1.0:1787574322.227629:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6165:x1874407323600256:12345-192.168.202.40@tcp:101: Request processed in 213us (3106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574322.227636:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00100000:1.0:1787574322.234442:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574322.234552:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323600384 00000100:00100000:0.0:1787574322.234577:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323600384 00000100:00100000:0.0:1787574322.234669:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:0.0:1787574322.234683:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6165:x1874407323600384:12345-192.168.202.40@tcp:501: 00000100:00100000:0.0:1787574322.235030:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6165:x1874407323600384:12345-192.168.202.40@tcp:501: Request processed in 349us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574322.235039:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:2.0:1787574322.239393:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574322.239871:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323600512 00000100:00100000:0.0:1787574322.239886:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323600512 00000100:00100000:0.0:1787574322.239976:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:0.0:1787574322.239989:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6165:x1874407323600512:12345-192.168.202.40@tcp:503: 00000100:00100000:0.0:1787574322.240194:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6165:x1874407323600512:12345-192.168.202.40@tcp:503: Request processed in 207us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574322.240204:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:3.0:1787574322.248468:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574322.249064:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323600640 00000100:00100000:1.0:1787574322.249081:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323600640 00000100:00100000:1.0:1787574322.249166:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:1.0:1787574322.249180:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6186:x1874407323600640:12345-192.168.202.40@tcp:502: 00000100:00100000:1.0:1787574322.249540:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6186:x1874407323600640:12345-192.168.202.40@tcp:502: Request processed in 362us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574322.249550:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:1.0:1787574322.273469:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574322.274214:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323600768 00000100:00100000:0.0:1787574322.274231:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323600768 00000100:00100000:0.0:1787574322.274363:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:0.0:1787574322.274376:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6186:x1874407323600768:12345-192.168.202.40@tcp:502: 00000100:00100000:0.0:1787574322.274604:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6186:x1874407323600768:12345-192.168.202.40@tcp:502: Request processed in 228us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574322.274613:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:3.0:1787574322.298849:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574322.299874:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574322.311836:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323600896 00000100:00100000:1.0:1787574322.311886:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323600896 00000100:00100000:1.0:1787574322.311970:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323601152 00000100:00100000:1.0:1787574322.311975:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323601152 00000100:00100000:1.0:1787574322.312011:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:1.0:1787574322.312023:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874407323600896:12345-192.168.202.40@tcp:38: 00010000:00080000:1.0:1787574322.312064:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:1.0:1787574322.312148:0:6511:0:(genops.c:1385:class_connect()) connect: client 1aeb3668-c6f6-4338-ab9b-0a7c9161b421, cookie 0xd18a1efeeddb7eb1 00000004:00100000:1.0:1787574322.312182:0:6511:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787574322.312500:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9ca403550800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574322.313147:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:2.0:1787574322.313156:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874407323601152:12345-192.168.202.40@tcp:38: 00010000:00080000:2.0:1787574322.313181:0:6510:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:2.0:1787574322.313228:0:6510:0:(genops.c:1385:class_connect()) connect: client 1aeb3668-c6f6-4338-ab9b-0a7c9161b421, cookie 0xd18a1efeeddb7eb8 00000004:00100000:2.0:1787574322.313275:0:6510:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787574322.314456:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2401:x1874407323600896:12345-192.168.202.40@tcp:38: Request processed in 2425us (15615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574322.314470:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00080000:2.0:1787574322.332322:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9ca4033b8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574322.332445:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2401:x1874407323601152:12345-192.168.202.40@tcp:38: Request processed in 19281us (32571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574322.332459:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1787574322.419902:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574322.419953:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346721408:0@lo:41: 00000100:00100000:1.0:1787574322.420049:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574322.420142:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346721408 00000100:00100000:1.0:1787574322.420152:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346721408 00000100:00100000:1.0:1787574322.420214:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787574322.420226:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346721408:12345-0@lo:41: 00000004:00000024:1.0:1787574322.420376:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787574322.420436:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346721408:12345-0@lo:41: Request processed in 212us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574322.420444:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787574322.420507:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346721408:0@lo:41: 00010000:00010000:0.0:1787574322.865510:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574322.932826:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346721664:0@lo:400: 00000100:00100000:0.0:1787574322.932947:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574322.933020:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346722176:0@lo:400: 00000100:00100000:0.0:1787574322.933051:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574322.933070:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346722688:0@lo:400: 00000100:00100000:0.0:1787574322.933096:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574322.933115:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346723200:0@lo:400: 00000100:00100000:0.0:1787574322.933135:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574322.933164:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787574322.933170:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346721792:0@lo:400: 00000100:00100000:0.0:1787574322.933197:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574322.933217:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346722304:0@lo:400: 00000100:00100000:0.0:1787574322.933264:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574322.933281:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346722816:0@lo:400: 00000100:00100000:0.0:1787574322.933304:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574322.933344:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346722688 00000100:00100000:0.0:1787574322.933353:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346722688 00000100:00100000:0.0:1787574322.933416:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346723200 00000100:00100000:0.0:1787574322.933427:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346723200 00000100:00100000:0.0:1787574322.933453:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787574322.933465:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346722688:12345-0@lo:400: 00000100:00100000:0.0:1787574322.933528:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346722688:12345-0@lo:400: Request processed in 66us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574322.933536:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787574322.933557:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574322.933564:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346723200:12345-0@lo:400: 00000100:00100000:0.0:1787574322.933593:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346723200:12345-0@lo:400: Request processed in 30us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574322.933598:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574322.933621:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346721792 00000100:00100000:0.0:1787574322.933625:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346721792 00000100:00100000:0.0:1787574322.933661:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346722304 00000100:00100000:0.0:1787574322.933664:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346722304 00000100:00100000:0.0:1787574322.933678:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346722816 00000100:00100000:0.0:1787574322.933681:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346722816 00000100:00100000:0.0:1787574322.933694:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787574322.933700:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346721792:12345-0@lo:400: 00000100:00100000:0.0:1787574322.933732:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346721792:12345-0@lo:400: Request processed in 32us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574322.933738:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787574322.933749:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787574322.933755:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346722304:12345-0@lo:400: 00000100:00100000:0.0:1787574322.933781:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346722304:12345-0@lo:400: Request processed in 27us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574322.933787:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787574322.933797:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574322.933811:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346722816:12345-0@lo:400: 00000100:00100000:0.0:1787574322.933839:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346722816:12345-0@lo:400: Request processed in 30us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574322.933846:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1787574322.933865:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574322.933871:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574322.933873:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574322.933910:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403486a00 x1874407346721792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574322.933926:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346721792:0@lo:400: 00010000:00080000:0.0:1787574322.933938:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504599f80 x1874407346722304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574322.933946:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346722304:0@lo:400: 00010000:00080000:0.0:1787574322.933956:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d51880 x1874407346722816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574322.933964:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346722816:0@lo:400: 00010000:00080000:0.0:1787574322.933974:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d50e00 x1874407346722688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574322.933981:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346722688:0@lo:400: 00010000:00080000:0.0:1787574322.933991:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53be5d180 x1874407346723200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574322.933999:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787574322.934015:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346723200:0@lo:400: 00000100:00100000:1.0:1787574322.934331:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346722176 00000100:00100000:1.0:1787574322.934337:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346722176 00000100:00100000:1.0:1787574322.934371:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787574322.934385:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346722176:12345-0@lo:400: 00000100:00100000:1.0:1787574322.934431:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346722176:12345-0@lo:400: Request processed in 47us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574322.934438:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787574322.934473:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346722176:0@lo:400: 00000100:00100000:1.0:1787574322.934483:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574322.934493:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346723328:0@lo:41: 00000100:00100000:1.0:1787574322.934521:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574322.934545:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346723328 00000100:00100000:1.0:1787574322.934549:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346723328 00000100:00100000:1.0:1787574322.934581:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787574322.934587:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346723328:12345-0@lo:41: 00000004:00000024:1.0:1787574322.934616:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574322.934664:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346723328:12345-0@lo:41: Request processed in 76us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574322.934670:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787574322.934699:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346723328:0@lo:41: 00000100:00100000:1.0:1787574322.934724:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346721664 00000100:00100000:1.0:1787574322.934728:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346721664 00000100:00100000:1.0:1787574322.934754:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787574322.934761:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346721664:12345-0@lo:400: 00000100:00100000:1.0:1787574322.934797:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346721664:12345-0@lo:400: Request processed in 37us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574322.934803:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787574322.934836:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346721664:0@lo:400: 00000100:00100000:3.0:1787574322.935632:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346721920:0@lo:400: 00000100:00100000:3.0:1787574322.935686:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574322.935711:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346722432:0@lo:400: 00000100:00100000:3.0:1787574322.935732:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574322.935748:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346722944:0@lo:400: 00000100:00100000:3.0:1787574322.935771:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574322.935784:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346723456:0@lo:13: 00000100:00100000:3.0:1787574322.935805:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574322.935826:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787574322.935832:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346721536:0@lo:13: 00000100:00100000:3.0:1787574322.935851:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574322.935865:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346722048:0@lo:400: 00000100:00100000:3.0:1787574322.935882:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574322.935893:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346722560:0@lo:400: 00000100:00100000:3.0:1787574322.935911:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574322.935940:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346723072:0@lo:400: 00000100:00100000:3.0:1787574322.935958:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574322.935988:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346723456 00000100:00100000:3.0:1787574322.935993:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346723456 00000100:00100000:3.0:1787574322.936022:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346721536 00000100:00100000:3.0:1787574322.936024:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346721536 00000100:00100000:3.0:1787574322.936053:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574322.936061:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346723456:12345-0@lo:13: 00002000:00000024:3.0:1787574322.936086:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574322.936128:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346723456:12345-0@lo:13: Request processed in 67us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574322.936149:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574322.936165:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574322.936172:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346721536:12345-0@lo:13: 00002000:00000024:3.0:1787574322.936182:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574322.936208:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346721536:12345-0@lo:13: Request processed in 36us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574322.936213:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574322.936236:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346722560 00000100:00100000:3.0:1787574322.936263:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346722560 00000100:00100000:3.0:1787574322.936290:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346723072 00000100:00100000:3.0:1787574322.936293:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346723072 00000100:00100000:3.0:1787574322.936308:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787574322.936314:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346722560:12345-0@lo:400: 00000100:00100000:3.0:1787574322.936347:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346722560:12345-0@lo:400: Request processed in 33us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574322.936353:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787574322.936364:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787574322.936370:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346723072:12345-0@lo:400: 00000100:00100000:3.0:1787574322.936395:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346723072:12345-0@lo:400: Request processed in 25us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574322.936401:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787574322.936419:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346722432 00000100:00100000:3.0:1787574322.936423:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346722432 00000100:00100000:3.0:1787574322.936442:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346722944 00000100:00100000:3.0:1787574322.936445:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346722944 00000100:00100000:3.0:1787574322.936456:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346722048 00000100:00100000:3.0:1787574322.936459:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346722048 00000100:00100000:3.0:1787574322.936483:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787574322.936489:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346722432:12345-0@lo:400: 00000100:00100000:3.0:1787574322.936519:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346722432:12345-0@lo:400: Request processed in 31us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574322.936525:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787574322.936536:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787574322.936542:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346722944:12345-0@lo:400: 00000100:00100000:3.0:1787574322.936568:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346722944:12345-0@lo:400: Request processed in 26us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574322.936574:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787574322.936587:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787574322.936593:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346722048:12345-0@lo:400: 00000100:00100000:3.0:1787574322.936618:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346722048:12345-0@lo:400: Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574322.936624:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787574322.936649:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574322.936655:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574322.936657:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787574322.936692:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d45180 x1874407346721536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574322.936703:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787574322.936725:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346721536:0@lo:13: 00010000:00080000:3.0:1787574322.936737:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403485f80 x1874407346722048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574322.936746:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346722048:0@lo:400: 00010000:00080000:3.0:1787574322.936756:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d53800 x1874407346722560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574322.936772:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346722560:0@lo:400: 00010000:00080000:3.0:1787574322.936783:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53be5d500 x1874407346723072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574322.936790:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346723072:0@lo:400: 00010000:00080000:3.0:1787574322.936799:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d53100 x1874407346722432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574322.936806:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346722432:0@lo:400: 00010000:00080000:3.0:1787574322.936814:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d52a00 x1874407346722944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574322.936821:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346722944:0@lo:400: 00010000:00080000:3.0:1787574322.936830:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403596d80 x1874407346723456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574322.936840:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346723456:0@lo:13: 00000100:00100000:3.0:1787574322.936868:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346721920 00000100:00100000:3.0:1787574322.936872:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346721920 00000100:00100000:3.0:1787574322.936896:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574322.936902:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346721920:12345-0@lo:400: 00000100:00100000:3.0:1787574322.936943:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346721920:12345-0@lo:400: Request processed in 42us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574322.936950:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574322.936972:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346721920:0@lo:400: 00000100:00100000:3.0:1787574323.341907:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574323.342097:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574323.349971:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574323.350500:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323601408 00000100:00100000:0.0:1787574323.350526:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323601408 00000100:00100000:0.0:1787574323.350654:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323601024 00000100:00100000:0.0:1787574323.350659:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323601024 00000100:00100000:0.0:1787574323.350691:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:0.0:1787574323.350704:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:6165:x1874407323601408:12345-192.168.202.40@tcp:41: 00000004:00000024:0.0:1787574323.350759:0:8610:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787574323.350850:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:6165:x1874407323601408:12345-192.168.202.40@tcp:41: Request processed in 148us (8957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574323.350859:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:0.0:1787574323.350885:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:0.0:1787574323.350891:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:0:x1874407323601024:12345-192.168.202.40@tcp:41: 00000004:00000024:0.0:1787574323.350904:0:8610:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787574323.350926:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:0:x1874407323601024:12345-192.168.202.40@tcp:41: Request processed in 35us (8829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574323.350931:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00080000:2.0:1787574323.353807:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574323.358173:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574323.359317:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323601280 00000100:00100000:2.0:1787574323.359335:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323601280 00000100:00100000:2.0:1787574323.359725:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323601536 00000100:00100000:2.0:1787574323.359730:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323601536 00000100:00100000:2.0:1787574323.359754:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:2.0:1787574323.359766:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:0:x1874407323601280:12345-192.168.202.40@tcp:41: 00000004:00000024:2.0:1787574323.359831:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787574323.359923:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:0:x1874407323601280:12345-192.168.202.40@tcp:41: Request processed in 159us (9967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574323.359932:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:2.0:1787574323.359952:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:2.0:1787574323.359959:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6165:x1874407323601536:12345-192.168.202.40@tcp:40: 00000100:00100000:2.0:1787574323.359995:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6165:x1874407323601536:12345-192.168.202.40@tcp:40: Request processed in 36us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574323.360001:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00080000:3.0:1787574323.360569:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787574323.365693:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574323.365806:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574323.366093:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574323.366142:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574323.366175:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323601664 00000100:00100000:3.0:1787574323.366187:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323601664 00000100:00100000:3.0:1787574323.366234:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323601792 00000100:00100000:3.0:1787574323.366237:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323601792 00000100:00100000:3.0:1787574323.366308:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1787574323.366319:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874407323601664:12345-192.168.202.40@tcp:8: 00010000:00080000:3.0:1787574323.366789:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1787574323.366829:0:8425:0:(genops.c:1385:class_connect()) connect: client 1aeb3668-c6f6-4338-ab9b-0a7c9161b421, cookie 0xd18a1efeeddb7ebf 00002000:00100000:3.0:1787574323.366845:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1aeb3668-c6f6-4338-ab9b-0a7c9161b421/ffff9ca403186000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787574323.366867:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787574323.367127:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787574323.367171:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9ca403182800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574323.367315:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2401:x1874407323601664:12345-192.168.202.40@tcp:8: Request processed in 995us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574323.367325:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1787574323.368527:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1787574323.368540:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1874407323601792:12345-192.168.202.40@tcp:8: 00010000:00080000:2.0:1787574323.368586:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:2.0:1787574323.368622:0:8426:0:(genops.c:1385:class_connect()) connect: client 1aeb3668-c6f6-4338-ab9b-0a7c9161b421, cookie 0xd18a1efeeddb7ec6 00002000:00100000:2.0:1787574323.368652:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1aeb3668-c6f6-4338-ab9b-0a7c9161b421/ffff9ca4033bf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787574323.368666:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787574323.368893:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787574323.368929:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9ca4033b9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574323.368990:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2401:x1874407323601792:12345-192.168.202.40@tcp:8: Request processed in 449us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574323.368999:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1787574323.369559:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323602048 00000100:00100000:1.0:1787574323.369579:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323602048 00000100:00100000:1.0:1787574323.369648:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00100000:1.0:1787574323.369658:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2404:x1874407323602048:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1787574323.369706:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2404:x1874407323602048:12345-192.168.202.40@tcp:400: Request processed in 50us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574323.369713:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00100000:0.0:1787574323.373750:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323601920 00000100:00100000:0.0:1787574323.373998:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323601920 00000100:00100000:2.0:1787574323.375824:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:2.0:1787574323.375843:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6165:x1874407323601920:12345-192.168.202.40@tcp:900: 00000100:00100000:2.0:1787574323.376007:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6165:x1874407323601920:12345-192.168.202.40@tcp:900: Request processed in 168us (10330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574323.376017:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:0.0:1787574323.387225:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574323.387544:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323602176 00000100:00100000:1.0:1787574323.387568:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323602176 00000100:00100000:1.0:1787574323.387649:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:1.0:1787574323.387662:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6165:x1874407323602176:12345-192.168.202.40@tcp:33: 00000004:00080000:1.0:1787574323.440934:0:6512:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 53153us 00000004:00200000:1.0:1787574323.484414:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787574323.484524:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6165:x1874407323602176:12345-192.168.202.40@tcp:33: Request processed in 96858us (97311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574323.484535:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00010000:00010000:3.0:1787574323.889531:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574323.920011:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574323.920578:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323602304 00000100:00100000:2.0:1787574323.920590:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323602304 00000100:00100000:2.0:1787574323.920717:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:2.0:1787574323.920728:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6204:x1874407323602304:12345-192.168.202.40@tcp:101: 00010000:00010000:2.0:1787574323.920749:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574323.920825:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83e00/0xd18a1efeeddb7ecd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b56a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574323.920889:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb7ed4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574323.920904:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb7ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574323.920918:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb7ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574323.920975:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787574323.920979:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574323.920995:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb7ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574323.921021:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83e00/0xd18a1efeeddb7ecd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b56a expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574323.921048:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb7ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b56a expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574323.921072:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca52057ff00) 00010000:00010000:2.0:1787574323.921075:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574323.921080:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83800, rc 0) 00000100:00100000:2.0:1787574323.921154:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:6204:x1874407323602304:12345-192.168.202.40@tcp:101: Request processed in 428us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574323.921160:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00010000:00010000:0.0:1787574324.913820:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574325.937517:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574326.001655:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574326.001680:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346723584:0@lo:13: 00000100:00100000:3.0:1787574326.001755:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574326.001922:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346723584 00000100:00100000:0.0:1787574326.001929:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346723584 00000100:00100000:0.0:1787574326.001995:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574326.002005:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346723584:12345-0@lo:13: 00002000:00000024:0.0:1787574326.002031:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574326.002073:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346723584:12345-0@lo:13: Request processed in 70us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574326.002079:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787574326.002329:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787574326.002366:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d46d80 x1874407346723584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574326.002392:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346723584:0@lo:13: 00000100:00100000:0.0:1787574326.002621:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346723712:0@lo:13: 00000100:00100000:0.0:1787574326.002649:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574326.002790:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346723712 00000100:00100000:1.0:1787574326.002795:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346723712 00000100:00100000:1.0:1787574326.002837:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787574326.002843:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346723712:12345-0@lo:13: 00002000:00000024:1.0:1787574326.002854:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574326.002887:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346723712:12345-0@lo:13: Request processed in 44us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574326.002892:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787574326.002961:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d44a80 x1874407346723712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574326.002972:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346723712:0@lo:13: 00000100:00080000:3.0:1787574326.003129:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574326.698338:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574326.698486:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323602432 00000100:00100000:3.0:1787574326.698496:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323602432 00000100:00100000:3.0:1787574326.698582:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:3.0:1787574326.698594:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:6256:x1874407323602432:12345-192.168.202.40@tcp:41: 00000004:00000024:3.0:1787574326.698641:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787574326.698708:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:6256:x1874407323602432:12345-192.168.202.40@tcp:41: Request processed in 117us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574326.698715:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00080000:2.0:1787574326.698919:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574326.702372:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574326.702562:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323602560 00000100:00100000:0.0:1787574326.702572:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323602560 00000100:00100000:0.0:1787574326.702660:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:0.0:1787574326.702671:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6256:x1874407323602560:12345-192.168.202.40@tcp:41: 00000004:00000024:0.0:1787574326.702707:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787574326.702774:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6256:x1874407323602560:12345-192.168.202.40@tcp:41: Request processed in 104us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574326.702782:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00080000:2.0:1787574326.702937:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574326.712349:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574326.713211:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323602688 00000100:00100000:0.0:1787574326.713222:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323602688 00000100:00080000:2.0:1787574326.713411:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574326.716122:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:0.0:1787574326.716145:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6256:x1874407323602688:12345-192.168.202.40@tcp:13: 00002000:00000024:0.0:1787574326.716172:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574326.716262:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6256:x1874407323602688:12345-192.168.202.40@tcp:13: Request processed in 127us (3923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574326.716269:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1787574326.731997:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574326.732129:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323602816 00000100:00100000:3.0:1787574326.732140:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323602816 00000100:00100000:3.0:1787574326.732212:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1787574326.732224:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6256:x1874407323602816:12345-192.168.202.40@tcp:13: 00002000:00000024:3.0:1787574326.732283:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574326.732341:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:6256:x1874407323602816:12345-192.168.202.40@tcp:13: Request processed in 121us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574326.732348:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00080000:2.0:1787574326.732623:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787574326.962184:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787574327.040742:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000100:00100000:0.0:1787574327.537692:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574327.537719:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346723840:0@lo:41: 00000100:00100000:0.0:1787574327.537787:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574327.538159:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346723840 00000100:00100000:3.0:1787574327.538168:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346723840 00000100:00100000:3.0:1787574327.538337:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574327.538348:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346723840:12345-0@lo:41: 00000004:00000024:3.0:1787574327.538395:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787574327.538458:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346723840:12345-0@lo:41: Request processed in 111us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574327.538473:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787574327.539019:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346723840:0@lo:41: 00000001:00100000:3.0:1787574327.539781:0:6488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000001:00100000:1.0:1787574327.556550:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00010000:00010000:3.0:1787574327.988780:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574328.049470:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574328.049498:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346723968:0@lo:41: 00000100:00100000:2.0:1787574328.049567:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574328.049820:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346723968 00000100:00100000:0.0:1787574328.049829:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346723968 00000100:00100000:0.0:1787574328.049880:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787574328.049889:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346723968:12345-0@lo:41: 00000004:00000024:0.0:1787574328.049923:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787574328.049973:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346723968:12345-0@lo:41: Request processed in 85us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574328.049980:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787574328.050025:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346723968:0@lo:41: 00000100:00100000:1.0:1787574328.050139:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346724224:0@lo:400: 00000100:00100000:1.0:1787574328.050173:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574328.050230:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346724352:0@lo:400: 00000100:00100000:1.0:1787574328.050272:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574328.050302:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346724352 00000100:00100000:1.0:1787574328.050305:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346724352 00000100:00100000:1.0:1787574328.050326:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787574328.050332:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346724352:12345-0@lo:400: 00000100:00100000:1.0:1787574328.050365:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346724352:12345-0@lo:400: Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.050371:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787574328.050395:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346724352:0@lo:400: 00000100:00100000:1.0:1787574328.050461:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346724736:0@lo:400: 00000100:00100000:1.0:1787574328.050483:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574328.050516:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346724224 00000100:00100000:1.0:1787574328.050520:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346724224 00000100:00100000:1.0:1787574328.050542:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346724736 00000100:00100000:1.0:1787574328.050545:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346724736 00000100:00100000:1.0:1787574328.050575:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787574328.050582:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346724224:12345-0@lo:400: 00000100:00100000:1.0:1787574328.050630:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346724224:12345-0@lo:400: Request processed in 49us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.050637:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787574328.050666:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787574328.050673:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346724736:12345-0@lo:400: 00000100:00100000:1.0:1787574328.050721:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346724736:12345-0@lo:400: Request processed in 48us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.050728:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787574328.050744:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787574328.050769:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d46a00 x1874407346724736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574328.050779:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346724736:0@lo:400: 00000100:00100000:1.0:1787574328.050789:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346724224:0@lo:400: 00000100:00100000:1.0:1787574328.050818:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346724864:0@lo:400: 00000100:00100000:1.0:1787574328.050841:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574328.050876:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346724864 00000100:00100000:1.0:1787574328.050879:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346724864 00000100:00100000:1.0:1787574328.050911:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787574328.050918:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346724864:12345-0@lo:400: 00000100:00100000:1.0:1787574328.050951:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346724864:12345-0@lo:400: Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.050957:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787574328.050973:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787574328.050988:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d46680 x1874407346724864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574328.050998:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346724864:0@lo:400: 00000100:00100000:1.0:1787574328.051036:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346725248:0@lo:400: 00000100:00100000:1.0:1787574328.051059:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574328.051095:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346725248 00000100:00100000:1.0:1787574328.051099:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346725248 00000100:00100000:1.0:1787574328.051122:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787574328.051128:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346725248:12345-0@lo:400: 00000100:00100000:1.0:1787574328.051160:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346725248:12345-0@lo:400: Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.051166:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787574328.051181:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787574328.051196:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d45880 x1874407346725248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574328.051205:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346725248:0@lo:400: 00000100:00100000:1.0:1787574328.051232:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346725376:0@lo:400: 00000100:00100000:1.0:1787574328.051279:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574328.051311:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346725376 00000100:00100000:1.0:1787574328.051314:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346725376 00000100:00100000:1.0:1787574328.051341:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787574328.051347:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346725376:12345-0@lo:400: 00000100:00100000:1.0:1787574328.051377:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346725376:12345-0@lo:400: Request processed in 31us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.051383:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787574328.051397:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787574328.051411:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d45880 x1874407346725376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574328.051419:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346725376:0@lo:400: 00000100:00100000:0.0:1787574328.052131:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346724096:0@lo:400: 00000100:00100000:0.0:1787574328.052186:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574328.052221:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346724608:0@lo:400: 00000100:00100000:0.0:1787574328.052277:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574328.052292:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346725120:0@lo:400: 00000100:00100000:0.0:1787574328.052312:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574328.052329:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787574328.052336:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346724480:0@lo:400: 00000100:00100000:0.0:1787574328.052354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574328.052364:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346724992:0@lo:400: 00000100:00100000:0.0:1787574328.052379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574328.052391:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346725504:0@lo:400: 00000100:00100000:0.0:1787574328.052406:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574328.052528:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346724096 00000100:00100000:2.0:1787574328.052534:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346724096 00000100:00100000:2.0:1787574328.052573:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787574328.052581:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346724096:12345-0@lo:400: 00000100:00100000:2.0:1787574328.052635:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346724096:12345-0@lo:400: Request processed in 55us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574328.052641:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787574328.054758:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346724992 00000100:00100000:1.0:1787574328.054773:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346724992 00000100:00100000:1.0:1787574328.054854:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346725504 00000100:00100000:1.0:1787574328.054871:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346725504 00000100:00100000:1.0:1787574328.054904:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787574328.054914:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346724992:12345-0@lo:400: 00000100:00100000:1.0:1787574328.054999:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346724992:12345-0@lo:400: Request processed in 87us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.055006:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787574328.055025:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574328.055031:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346725504:12345-0@lo:400: 00000100:00100000:1.0:1787574328.055058:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346725504:12345-0@lo:400: Request processed in 28us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.055063:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574328.055087:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346724608 00000100:00100000:1.0:1787574328.055091:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346724608 00000100:00100000:1.0:1787574328.055111:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346725120 00000100:00100000:1.0:1787574328.055115:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346725120 00000100:00100000:1.0:1787574328.055126:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346724480 00000100:00100000:1.0:1787574328.055128:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346724480 00000100:00100000:1.0:1787574328.055141:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787574328.055146:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346724608:12345-0@lo:400: 00000100:00100000:1.0:1787574328.055193:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346724608:12345-0@lo:400: Request processed in 46us (2915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.055199:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787574328.055212:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787574328.055217:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346725120:12345-0@lo:400: 00000100:00100000:1.0:1787574328.055276:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346725120:12345-0@lo:400: Request processed in 58us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.055282:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787574328.055294:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787574328.055307:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346724480:12345-0@lo:400: 00000100:00100000:1.0:1787574328.055337:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346724480:12345-0@lo:400: Request processed in 32us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574328.055342:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787574328.055718:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574328.055723:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574328.055725:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574328.055949:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574328.055966:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346725632:0@lo:13: 00000100:00100000:3.0:1787574328.056008:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574328.056088:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346725632 00000100:00100000:2.0:1787574328.056093:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346725632 00000100:00100000:2.0:1787574328.056131:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787574328.056140:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346725632:12345-0@lo:13: 00002000:00000024:2.0:1787574328.056186:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574328.056227:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346725632:12345-0@lo:13: Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574328.056234:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787574328.056500:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5349fdf80 x1874407346725632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574328.056518:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346725632:0@lo:13: 00000100:00100000:0.0:1787574328.057380:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346724480:0@lo:400: 00010000:00080000:0.0:1787574328.057397:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d46680 x1874407346724992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574328.057422:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346724992:0@lo:400: 00010000:00080000:0.0:1787574328.057436:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d45880 x1874407346725504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574328.057443:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346725504:0@lo:400: 00000100:00100000:0.0:1787574328.057453:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346724096:0@lo:400: 00000100:00100000:0.0:1787574328.057465:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346724608:0@lo:400: 00000100:00100000:0.0:1787574328.057476:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346725120:0@lo:400: 00000100:00100000:3.0:1787574328.058582:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574328.058616:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346725760:0@lo:13: 00000100:00100000:3.0:1787574328.058680:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574328.058816:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346725760 00000100:00100000:0.0:1787574328.058822:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346725760 00000100:00100000:0.0:1787574328.058871:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787574328.058881:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346725760:12345-0@lo:13: 00002000:00000024:0.0:1787574328.058903:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574328.058953:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346725760:12345-0@lo:13: Request processed in 73us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574328.058961:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787574328.059044:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d44700 x1874407346725760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574328.059060:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346725760:0@lo:13: 00000001:00100000:3.0:1787574328.562928:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000100:00100000:1.0:1787574328.587018:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574328.587071:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574328.587111:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574328.587212:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323603200 00000100:00100000:3.0:1787574328.587221:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323603200 00000100:00100000:3.0:1787574328.587307:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:3.0:1787574328.587317:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323603200:12345-192.168.202.40@tcp:400: 00000100:00100000:3.0:1787574328.587389:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323603200:12345-192.168.202.40@tcp:400: Request processed in 74us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574328.587396:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:1.0:1787574328.587997:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574328.588024:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574328.588124:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323603072 00000100:00100000:3.0:1787574328.588130:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323603072 00000100:00100000:3.0:1787574328.588163:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:3.0:1787574328.588171:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323603072:12345-192.168.202.40@tcp:400: 00000100:00100000:3.0:1787574328.588212:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323603072:12345-192.168.202.40@tcp:400: Request processed in 42us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574328.588232:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:2.0:1787574328.589916:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323602944 00000100:00100000:2.0:1787574328.589929:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323602944 00000100:00100000:2.0:1787574328.589996:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:2.0:1787574328.590006:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2403:x1874407323602944:12345-192.168.202.40@tcp:400: 00000100:00100000:2.0:1787574328.590073:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2403:x1874407323602944:12345-192.168.202.40@tcp:400: Request processed in 68us (3275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574328.590080:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00080000:2.0:1787574328.590114:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574328.590119:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574328.596372:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323603456 00000100:00100000:0.0:1787574328.596387:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323603456 00000100:00100000:0.0:1787574328.596535:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323603328 00000100:00100000:0.0:1787574328.596539:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323603328 00000100:00100000:2.0:1787574328.596671:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1787574328.596684:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323603456:12345-192.168.202.40@tcp:400: 00000100:00100000:2.0:1787574328.596774:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323603456:12345-192.168.202.40@tcp:400: Request processed in 94us (9663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574328.596782:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00080000:1.0:1787574328.601647:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574328.601843:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1787574328.601858:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323603328:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1787574328.601952:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323603328:12345-192.168.202.40@tcp:400: Request processed in 99us (13926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574328.601961:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00080000:2.0:1787574328.604964:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787574329.009417:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574330.044054:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574330.257094:0:10176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787574331.057410:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574331.125089:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346725888:0@lo:13: 00000100:00100000:2.0:1787574331.125164:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574331.125604:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346725888 00000100:00100000:1.0:1787574331.125613:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346725888 00000100:00100000:1.0:1787574331.125682:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787574331.125693:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346725888:12345-0@lo:13: 00002000:00000024:1.0:1787574331.125724:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574331.125772:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346725888:12345-0@lo:13: Request processed in 82us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574331.125780:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787574331.126058:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574331.126093:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d46680 x1874407346725888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574331.126113:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346725888:0@lo:13: 00000100:00100000:2.0:1787574331.136698:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346726016:0@lo:13: 00000100:00100000:2.0:1787574331.136785:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574331.136861:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346726016 00000100:00100000:2.0:1787574331.136881:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346726016 00000100:00100000:2.0:1787574331.136934:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574331.136943:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346726016:12345-0@lo:13: 00002000:00000024:2.0:1787574331.136964:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574331.137007:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346726016:12345-0@lo:13: Request processed in 65us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574331.137015:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787574331.137054:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574331.137082:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d46d80 x1874407346726016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574331.137102:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346726016:0@lo:13: 00010000:00010000:3.0:1787574332.081486:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574332.679324:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574332.679350:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346726144:0@lo:41: 00000100:00100000:3.0:1787574332.679487:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574332.679662:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346726144 00000100:00100000:1.0:1787574332.679670:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346726144 00000100:00100000:1.0:1787574332.679737:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787574332.679747:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346726144:12345-0@lo:41: 00000004:00000024:1.0:1787574332.679781:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787574332.679851:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346726144:12345-0@lo:41: Request processed in 105us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574332.679873:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787574332.679919:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346726144:0@lo:41: 00010000:00010000:0.0:1787574333.105406:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574333.170918:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346726528:0@lo:400: 00000100:00100000:3.0:1787574333.171004:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574333.171057:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346727040:0@lo:400: 00000100:00100000:3.0:1787574333.171084:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574333.171110:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346727552:0@lo:400: 00000100:00100000:3.0:1787574333.171132:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574333.171156:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787574333.171162:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346726656:0@lo:400: 00000100:00100000:3.0:1787574333.171183:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574333.171199:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346727168:0@lo:400: 00000100:00100000:3.0:1787574333.171222:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574333.171263:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346727680:0@lo:400: 00000100:00100000:3.0:1787574333.171509:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574333.172482:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346726528 00000100:00100000:3.0:1787574333.172493:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346726528 00000100:00100000:3.0:1787574333.172562:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787574333.172572:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346726528:12345-0@lo:400: 00000100:00100000:2.0:1787574333.172619:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346726400:0@lo:400: 00000100:00100000:3.0:1787574333.172638:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346726528:12345-0@lo:400: Request processed in 67us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574333.172662:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787574333.172664:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574333.172693:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346727040 00000100:00100000:2.0:1787574333.172693:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346726912:0@lo:400: 00000100:00100000:3.0:1787574333.172699:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346727040 00000100:00100000:2.0:1787574333.172721:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574333.172733:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346727424:0@lo:400: 00000100:00100000:2.0:1787574333.172754:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574333.172766:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346727936:0@lo:13: 00000100:00100000:2.0:1787574333.172822:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574333.173413:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787574333.173423:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346726272:0@lo:400: 00000100:00100000:2.0:1787574333.173458:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574333.173484:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346726784:0@lo:400: 00000100:00100000:2.0:1787574333.173538:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574333.173568:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346727296:0@lo:400: 00000100:00100000:2.0:1787574333.173590:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574333.173609:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346727808:0@lo:400: 00000100:00100000:2.0:1787574333.173631:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574333.173662:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346727168 00000100:00100000:2.0:1787574333.173667:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346727168 00000100:00100000:2.0:1787574333.173694:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346727680 00000100:00100000:2.0:1787574333.173697:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346727680 00000100:00100000:2.0:1787574333.173710:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346727296 00000100:00100000:2.0:1787574333.173712:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346727296 00000100:00100000:2.0:1787574333.173723:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346727808 00000100:00100000:2.0:1787574333.173726:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346727808 00000100:00100000:2.0:1787574333.173740:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787574333.173747:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346727168:12345-0@lo:400: 00000100:00100000:2.0:1787574333.173786:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346727168:12345-0@lo:400: Request processed in 39us (2563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.173793:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787574333.173807:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787574333.173814:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346727680:12345-0@lo:400: 00000100:00100000:2.0:1787574333.173842:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346727680:12345-0@lo:400: Request processed in 29us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.173848:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787574333.173861:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574333.173866:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346727296:12345-0@lo:400: 00000100:00100000:2.0:1787574333.173897:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346727296:12345-0@lo:400: Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.173912:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574333.174575:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787574333.174585:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346727808:12345-0@lo:400: 00000100:00100000:2.0:1787574333.174622:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346727808:12345-0@lo:400: Request processed in 40us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.174627:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787574333.174649:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346727552 00000100:00100000:2.0:1787574333.174654:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346727552 00000100:00100000:2.0:1787574333.174676:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346726656 00000100:00100000:2.0:1787574333.174680:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346726656 00000100:00100000:2.0:1787574333.174696:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346726400 00000100:00100000:2.0:1787574333.174698:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346726400 00000100:00100000:2.0:1787574333.174708:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346726912 00000100:00100000:2.0:1787574333.174710:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346726912 00000100:00100000:2.0:1787574333.174724:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346727424 00000100:00100000:2.0:1787574333.174727:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346727424 00000100:00100000:2.0:1787574333.174744:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787574333.174752:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346727040:12345-0@lo:400: 00000100:00100000:2.0:1787574333.174788:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346727040:12345-0@lo:400: Request processed in 37us (3703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.174803:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787574333.174819:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787574333.174826:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346727552:12345-0@lo:400: 00000100:00100000:2.0:1787574333.174856:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346727552:12345-0@lo:400: Request processed in 31us (3723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.174861:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787574333.174872:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787574333.174878:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346726656:12345-0@lo:400: 00000100:00100000:2.0:1787574333.175614:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346726656:12345-0@lo:400: Request processed in 38us (3732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.175622:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787574333.175640:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787574333.175647:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346726400:12345-0@lo:400: 00000100:00100000:2.0:1787574333.175694:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346726400:12345-0@lo:400: Request processed in 49us (3035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.175700:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787574333.175711:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787574333.175717:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346726912:12345-0@lo:400: 00000100:00100000:2.0:1787574333.175739:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346726912:12345-0@lo:400: Request processed in 22us (3019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.175744:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787574333.175753:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787574333.175758:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346727424:12345-0@lo:400: 00000100:00100000:2.0:1787574333.175778:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346727424:12345-0@lo:400: Request processed in 20us (3024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.175783:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787574333.175810:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574333.175815:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574333.175818:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574333.175821:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787574333.175833:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346727936 00000100:00100000:2.0:1787574333.175838:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346727936 00000100:00100000:2.0:1787574333.175872:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787574333.175879:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787574333.175880:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346727936:12345-0@lo:13: 00000100:00100000:0.0:1787574333.175892:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1787574333.175906:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574333.177270:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346727936:12345-0@lo:13: Request processed in 1388us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.177278:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787574333.177310:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346726272 00000100:00100000:2.0:1787574333.177314:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346726272 00000100:00100000:2.0:1787574333.177357:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787574333.177363:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346726272:12345-0@lo:400: 00000100:00100000:2.0:1787574333.187154:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346726272:12345-0@lo:400: Request processed in 32us (3937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.187170:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787574333.187274:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346728192:0@lo:41: 00000100:00100000:2.0:1787574333.187334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574333.187377:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574333.187386:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346728064:0@lo:13: 00000100:00100000:2.0:1787574333.187412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574333.187448:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346728064 00000100:00100000:2.0:1787574333.187456:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346728064 00000100:00100000:2.0:1787574333.187505:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574333.187515:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346728064:12345-0@lo:13: 00002000:00000024:2.0:1787574333.187537:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574333.187594:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346728064:12345-0@lo:13: Request processed in 80us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.187600:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787574333.187640:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8e680 x1874407346728064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574333.187658:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346728064:0@lo:13: 00000100:00100000:2.0:1787574333.187683:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346726784 00000100:00100000:2.0:1787574333.187700:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346726784 00000100:00100000:2.0:1787574333.187719:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346728192 00000100:00100000:2.0:1787574333.187722:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346728192 00000100:00100000:2.0:1787574333.187734:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787574333.187740:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346726784:12345-0@lo:400: 00000100:00100000:2.0:1787574333.187775:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346726784:12345-0@lo:400: Request processed in 35us (14236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.187782:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787574333.187796:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787574333.187803:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346728192:12345-0@lo:41: 00000004:00000024:2.0:1787574333.187825:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787574333.187912:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346728192:12345-0@lo:41: Request processed in 109us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574333.188073:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346728192:0@lo:41: 00000100:00100000:0.0:1787574333.188481:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346726656:0@lo:400: 00010000:00080000:0.0:1787574333.188497:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504592a00 x1874407346727168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574333.188506:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346727168:0@lo:400: 00010000:00080000:0.0:1787574333.188517:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402692680 x1874407346727680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574333.188525:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346727680:0@lo:400: 00000100:00100000:0.0:1787574333.188537:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346726528:0@lo:400: 00010000:00080000:0.0:1787574333.188560:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504590700 x1874407346727040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574333.188570:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346727040:0@lo:400: 00010000:00080000:0.0:1787574333.188583:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402693800 x1874407346727552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574333.188590:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346727552:0@lo:400: 00000100:00100000:0.0:1787574333.188658:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346726272:0@lo:400: 00000100:00100000:0.0:1787574333.188670:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346726784:0@lo:400: 00010000:00080000:0.0:1787574333.188682:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504591f80 x1874407346727296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574333.188702:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346727296:0@lo:400: 00010000:00080000:0.0:1787574333.188714:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402690380 x1874407346727808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574333.188730:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346727808:0@lo:400: 00000100:00100000:0.0:1787574333.188742:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346726400:0@lo:400: 00000100:00100000:0.0:1787574333.188753:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346726912:0@lo:400: 00000100:00100000:0.0:1787574333.188765:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346727424:0@lo:400: 00010000:00080000:0.0:1787574333.188775:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5349fdf80 x1874407346727936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574333.188786:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346727936:0@lo:13: 00000100:00100000:2.0:1787574333.191614:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787574333.707857:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574333.707899:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574333.707923:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574333.707940:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574333.707977:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574333.708003:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323603840 00000100:00100000:0.0:1787574333.708012:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323603840 00000100:00100000:0.0:1787574333.708063:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323603712 00000100:00100000:0.0:1787574333.708067:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323603712 00000100:00100000:0.0:1787574333.708091:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:0.0:1787574333.708101:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323603840:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1787574333.708180:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323603840:12345-192.168.202.40@tcp:400: Request processed in 79us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574333.708202:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:0.0:1787574333.708219:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:0.0:1787574333.708226:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323603712:12345-192.168.202.40@tcp:400: 00000100:00100000:2.0:1787574333.708371:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323603584 00000100:00100000:2.0:1787574333.708376:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323603584 00000100:00100000:2.0:1787574333.708405:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 201 00000100:00100000:2.0:1787574333.708412:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2404:x1874407323603584:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1787574333.708517:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323603712:12345-192.168.202.40@tcp:400: Request processed in 291us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574333.708524:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:3.0:1787574333.709572:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323604096 00000100:00100000:3.0:1787574333.709579:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323604096 00000100:00100000:3.0:1787574333.709622:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323603968 00000100:00100000:3.0:1787574333.709625:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323603968 00000100:00100000:3.0:1787574333.709650:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1787574333.709657:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323604096:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1787574333.709776:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1787574333.709785:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323603968:12345-192.168.202.40@tcp:400: 00000100:00100000:2.0:1787574333.718869:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2404:x1874407323603584:12345-192.168.202.40@tcp:400: Request processed in 10445us (11009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574333.718885:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 201 00000100:00080000:2.0:1787574333.718956:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574333.718963:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574333.718967:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574333.718969:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574333.720208:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323604096:12345-192.168.202.40@tcp:400: Request processed in 10544us (12275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574333.720220:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:1.0:1787574333.725403:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323603968:12345-192.168.202.40@tcp:400: Request processed in 15603us (17408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574333.725420:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00010000:00010000:3.0:1787574334.134021:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574335.156373:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574336.181065:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574336.241552:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346728320:0@lo:13: 00000100:00100000:2.0:1787574336.241654:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574336.241789:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346728320 00000100:00100000:2.0:1787574336.241799:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346728320 00000100:00100000:3.0:1787574336.241805:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346728448:0@lo:13: 00000100:00100000:3.0:1787574336.241839:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574336.241865:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346728448 00000100:00100000:2.0:1787574336.241868:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346728448 00000100:00080000:3.0:1787574336.241875:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574336.241889:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787574336.241900:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787574336.241901:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346728320:12345-0@lo:13: 00000100:00100000:3.0:1787574336.241909:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346728448:12345-0@lo:13: 00002000:00000024:3.0:1787574336.241937:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787574336.241937:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574336.241984:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346728320:12345-0@lo:13: Request processed in 85us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574336.241992:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787574336.241996:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346728448:12345-0@lo:13: Request processed in 90us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574336.242002:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787574336.242041:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402691500 x1874407346728448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574336.242065:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346728448:0@lo:13: 00010000:00080000:2.0:1787574336.244570:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8e680 x1874407346728320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574336.244608:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346728320:0@lo:13: 00000020:00000080:0.0:1787574336.249156:0:10324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4e762e50 20000000:00000080:0.0:1787574336.249183:0:10324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ca403433400 uarg=0000000000000000 20000000:01000000:0.0:1787574336.249292:0:10324:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787574336.249295:0:10324:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787574336.249299:0:10324:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787574336.249304:0:10324:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787574336.249312:0:10324:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787574336.249394:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787574336.249397:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787574336.261541:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1787574336.262046:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1787574336.262078:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1787574336.262091:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1787574336.262101:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787574336.262104:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787574336.262926:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1787574336.263576:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1787574336.263611:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1787574336.263624:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1787574336.263640:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787574336.263642:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787574336.264264:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1787574336.264584:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1787574336.264610:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1787574336.264625:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1787574336.264635:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787574336.264637:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787574336.265517:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1787574336.265855:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1787574336.265881:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1787574336.265894:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1787574336.265904:0:10324:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787574336.265906:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787574336.266752:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1787574336.267081:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1787574336.267109:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1787574336.267142:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:2.0:1787574336.267161:0:10324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787574336.267198:0:10324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267235:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb7d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d6f expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267600:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb7da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d99 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267607:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb7ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7dd8 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267614:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7de6 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267620:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb7dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7df4 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267627:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e10 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267634:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e33 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267640:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e56 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267647:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7e87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7e80 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267784:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7e95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b4fa expref: 9 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267794:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb7e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b501 expref: 9 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267803:0:10324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267856:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb7e9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b501 expref: 9 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.267875:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb7e9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b501 expref: 9 pid: 6501 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574336.267894:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346728576:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574336.268066:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b4fa expref: 9 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.268075:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7e95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b4fa expref: 9 pid: 6501 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574336.268085:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346728704:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574336.268122:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7e80 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.268131:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7e87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e80 expref: 23 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574336.268154:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346728832:0@lo:104: 00000100:00100000:2.0:1787574336.268578:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574336.268657:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7e56 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.269121:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7e5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e56 expref: 23 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574336.269140:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346728960:0@lo:104: 00000100:00100000:2.0:1787574336.269179:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574336.269374:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7e33 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.269384:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7e3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e33 expref: 23 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574336.269392:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729088:0@lo:104: 00000100:00100000:2.0:1787574336.269415:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574336.277975:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7e10 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.278002:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7e17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e10 expref: 23 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574336.278021:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729216:0@lo:104: 00000100:00100000:2.0:1787574336.278105:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.278519:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346728832 00000100:00100000:1.0:1787574336.278540:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346728832 00000100:00100000:1.0:1787574336.278610:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346728960 00000100:00100000:1.0:1787574336.278614:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346728960 00000100:00100000:1.0:1787574336.278626:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346729088 00000100:00100000:1.0:1787574336.278629:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346729088 00000100:00100000:1.0:1787574336.278645:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574336.278657:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:10324:x1874407346728832:12345-0@lo:104: 00010000:00010000:1.0:1787574336.279096:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.279201:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787574336.279219:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:10324:x1874407346728832:12345-0@lo:104: Request processed in 553us (10633us total) trans 0 rc 0/0 00010000:00010000:2.0:1787574336.279419:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb7dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7df4 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.279449:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb7dfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7df4 expref: 23 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574336.279464:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729344:0@lo:104: 00010000:00010000:2.0:1787574336.279503:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7de6 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.279511:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7ded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7de6 expref: 23 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574336.279518:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729472:0@lo:104: 00010000:00010000:2.0:1787574336.279556:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb7ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7dd8 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.279565:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb7ddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7dd8 expref: 23 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574336.279573:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729600:0@lo:104: 00010000:00010000:2.0:1787574336.279611:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb7da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7d99 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.279621:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb7da0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d99 expref: 23 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574336.279629:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729728:0@lo:104: 00010000:00010000:2.0:1787574336.279654:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb7d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7d6f expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.279835:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574336.279883:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787574336.279904:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.279917:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.279948:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.279963:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.279971:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346729216 00000100:00100000:1.0:1787574336.279978:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346729216 00000100:00100000:1.0:1787574336.280006:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346729344 00000100:00100000:1.0:1787574336.280009:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346729344 00000100:00100000:1.0:1787574336.280019:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346729472 00000100:00100000:1.0:1787574336.280021:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346729472 00000100:00100000:1.0:1787574336.280031:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346729600 00000100:00100000:1.0:1787574336.280033:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346729600 00000100:00100000:1.0:1787574336.280041:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346729728 00000100:00100000:1.0:1787574336.280043:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346729728 00000100:00100000:1.0:1787574336.280054:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787574336.280062:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:10324:x1874407346728960:12345-0@lo:104: 00010000:00010000:1.0:1787574336.280074:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.280192:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb7d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d6f expref: 23 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574336.280202:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729856:0@lo:104: 00000100:00100000:2.0:1787574336.280228:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574336.280346:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787574336.280353:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+9:10324:x1874407346728960:12345-0@lo:104: Request processed in 291us (11173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.280361:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787574336.280378:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574336.280385:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+8:10324:x1874407346729088:12345-0@lo:104: 00010000:00010000:1.0:1787574336.280394:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.280436:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787574336.280441:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+8:10324:x1874407346729088:12345-0@lo:104: Request processed in 58us (11026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.280447:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574336.280466:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574336.280471:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4024a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+7:10324:x1874407346729216:12345-0@lo:104: 00010000:00010000:1.0:1787574336.280479:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.280506:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787574336.280511:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4024a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+7:10324:x1874407346729216:12345-0@lo:104: Request processed in 40us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.280516:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574336.280565:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787574336.280571:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+6:10324:x1874407346729344:12345-0@lo:104: 00010000:00010000:1.0:1787574336.280579:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.280605:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787574336.280610:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+6:10324:x1874407346729344:12345-0@lo:104: Request processed in 39us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.280616:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787574336.280628:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787574336.280634:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:10324:x1874407346729472:12345-0@lo:104: 00010000:00010000:1.0:1787574336.280641:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.280666:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787574336.280797:0:10324:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574336.280830:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346728832:0@lo:104: 00000100:00100000:2.0:1787574336.280841:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346728960:0@lo:104: 00000100:00100000:2.0:1787574336.280848:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729088:0@lo:104: 00000100:00100000:2.0:1787574336.280856:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729216:0@lo:104: 00000100:00100000:2.0:1787574336.280863:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729344:0@lo:104: 00000100:00100000:2.0:1787574336.280869:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729472:0@lo:104: 00000100:00100000:1.0:1787574336.280946:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:10324:x1874407346729472:12345-0@lo:104: Request processed in 38us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.280954:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787574336.280972:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346729856 00000100:00100000:1.0:1787574336.280977:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346729856 00000100:00100000:1.0:1787574336.280994:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787574336.280999:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:10324:x1874407346729600:12345-0@lo:104: 00010000:00010000:1.0:1787574336.281007:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281046:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787574336.281051:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:10324:x1874407346729600:12345-0@lo:104: Request processed in 52us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.281057:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787574336.281068:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787574336.281073:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:10324:x1874407346729728:12345-0@lo:104: 00010000:00010000:1.0:1787574336.281080:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281101:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1787574336.281106:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:10324:x1874407346729728:12345-0@lo:104: Request processed in 34us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.281111:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787574336.281131:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787574336.281137:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:10324:x1874407346729856:12345-0@lo:104: 00010000:00010000:1.0:1787574336.281145:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281167:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1787574336.281171:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:10324:x1874407346729856:12345-0@lo:104: Request processed in 34us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.281185:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787574336.281206:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1787574336.281213:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281221:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83c00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574336.281226:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281545:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574336.281554:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574336.281561:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574336.281609:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281615:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574336.281639:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281646:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83c00/0xd18a1efeeddb7e80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281661:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1787574336.281664:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281793:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574336.281797:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281805:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574336.281811:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574336.281816:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574336.281830:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281836:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574336.281841:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281846:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c10600/0xd18a1efeeddb7e56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281855:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787574336.281859:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281865:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574336.281867:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281883:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574336.281889:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574336.281894:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574336.281907:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.281913:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787574336.282030:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729600:0@lo:104: 00000100:00100000:2.0:1787574336.282040:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729728:0@lo:104: 00000100:00100000:2.0:1787574336.282047:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346729856:0@lo:104: 00010000:00010000:1.0:1787574336.282903:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.282918:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c10a00/0xd18a1efeeddb7e33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.282934:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787574336.282938:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.282945:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574336.282949:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.282958:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574336.282966:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574336.282984:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574336.283017:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283023:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574336.283032:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283038:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb7e10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7e17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283046:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787574336.283050:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283056:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11800 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574336.283059:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283066:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574336.283073:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574336.283078:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574336.283090:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283096:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574336.283107:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283113:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c11800/0xd18a1efeeddb7df4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7dfb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283201:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787574336.283206:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283222:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99800 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574336.283225:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283377:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574336.283383:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574336.283389:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574336.283407:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283413:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574336.283418:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283424:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be99800/0xd18a1efeeddb7de6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ded expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283434:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787574336.283444:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283451:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be98c00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574336.283454:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283460:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574336.283467:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574336.283472:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574336.283486:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283492:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574336.283497:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283503:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7dd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ddf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283513:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574336.283515:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283533:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574336.283535:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283553:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574336.283559:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574336.283565:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574336.283580:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283586:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574336.283590:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283596:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb7d99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7da0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283604:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574336.283608:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283613:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11c00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574336.283615:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283622:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574336.283628:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574336.283637:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574336.283648:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283653:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574336.283657:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283663:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d76 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.283803:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574336.283806:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574336.283808:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574336.283840:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346729984:0@lo:103: 00000100:00100000:1.0:1787574336.283931:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.283986:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346730496:0@lo:103: 00000100:00100000:1.0:1787574336.284007:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.284029:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346731008:0@lo:103: 00000100:00100000:1.0:1787574336.284046:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.284071:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787574336.284077:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346730112:0@lo:103: 00000100:00100000:1.0:1787574336.284095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.284110:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346730624:0@lo:103: 00000100:00100000:1.0:1787574336.284127:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.284152:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346730240:0@lo:103: 00000100:00100000:1.0:1787574336.284196:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.284207:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346730752:0@lo:103: 00010000:00010000:3.0:1787574336.284416:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574336.284429:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346730368:0@lo:103: 00000100:00100000:3.0:1787574336.284459:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574336.284476:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346730880:0@lo:103: 00000100:00100000:3.0:1787574336.284495:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.284897:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574336.284936:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346729984 00000100:00100000:1.0:1787574336.284946:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346729984 00010000:00010000:1.0:1787574336.284988:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7e87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e80 expref: 24 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.285017:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346730496 00000100:00100000:1.0:1787574336.285021:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346730496 00010000:00010000:1.0:1787574336.285033:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb7dfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7df4 expref: 25 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.285042:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346731008 00000100:00100000:1.0:1787574336.285044:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346731008 00010000:00010000:1.0:1787574336.285053:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb7d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d6f expref: 26 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.285062:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346730112 00000100:00100000:1.0:1787574336.285064:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346730112 00010000:00010000:1.0:1787574336.285074:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7e5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e56 expref: 27 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.285083:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346730624 00000100:00100000:1.0:1787574336.285086:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346730624 00010000:00010000:1.0:1787574336.285096:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7ded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7de6 expref: 28 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.285105:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346730240 00000100:00100000:1.0:1787574336.285107:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346730240 00010000:00010000:1.0:1787574336.285117:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7e3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e33 expref: 29 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.285143:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346730368 00000100:00100000:1.0:1787574336.285146:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346730368 00010000:00010000:1.0:1787574336.285157:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7e17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e10 expref: 30 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.285166:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346730880 00000100:00100000:1.0:1787574336.285169:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346730880 00010000:00010000:1.0:1787574336.285179:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb7da0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d99 expref: 31 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.285188:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346730752 00000100:00100000:1.0:1787574336.285190:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346730752 00010000:00010000:1.0:1787574336.285199:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb7ddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7dd8 expref: 32 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.285352:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574336.285365:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+32:3636:x1874407346729984:12345-0@lo:103: 00010000:00010000:1.0:1787574336.285382:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574336.285389:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7e87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e80 expref: 32 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.285402:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e80 expref: 32 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.285424:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7e87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7e80 expref: 32 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.285441:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574336.285488:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+31:3636:x1874407346729984:12345-0@lo:103: Request processed in 126us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.285505:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574336.285569:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787574336.285575:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+30:3636:x1874407346730496:12345-0@lo:103: 00010000:00010000:1.0:1787574336.285582:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574336.285587:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb7dfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7df4 expref: 30 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.285597:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb7dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7df4 expref: 30 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.285608:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb7dfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7df4 expref: 30 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.285616:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574336.285640:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+29:3636:x1874407346730496:12345-0@lo:103: Request processed in 65us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.285647:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787574336.285658:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574336.285664:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+28:3636:x1874407346731008:12345-0@lo:103: 00000100:00100000:0.0:1787574336.285869:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574336.285956:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:1.0:1787574336.286051:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574336.286057:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb7d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d6f expref: 28 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286067:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb7d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d6f expref: 28 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286079:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb7d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7d6f expref: 28 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286101:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574336.286128:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+27:3636:x1874407346731008:12345-0@lo:103: Request processed in 464us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.286135:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574336.286150:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323604224 00000100:00100000:1.0:1787574336.286156:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323604224 00010000:00010000:1.0:1787574336.286175:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb7e9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b501 expref: 10 pid: 6501 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.286189:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323604352 00000100:00100000:1.0:1787574336.286191:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323604352 00010000:00010000:1.0:1787574336.286200:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7e95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b4fa expref: 11 pid: 6501 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574336.286224:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574336.286264:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+26:3636:x1874407346730112:12345-0@lo:103: 00010000:00010000:1.0:1787574336.286273:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574336.286278:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7e5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e56 expref: 26 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286287:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e56 expref: 26 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286297:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7e5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7e56 expref: 26 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286306:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574336.286331:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+25:3636:x1874407346730112:12345-0@lo:103: Request processed in 101us (2235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.286347:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574336.286363:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787574336.286369:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346730624:12345-0@lo:103: 00010000:00010000:1.0:1787574336.286378:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574336.286382:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7ded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7de6 expref: 24 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286390:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7de6 expref: 24 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286400:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7ded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7de6 expref: 24 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286407:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574336.286432:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:3636:x1874407346730624:12345-0@lo:103: Request processed in 63us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.286438:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787574336.286450:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787574336.286455:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3634:x1874407346730240:12345-0@lo:103: 00010000:00010000:1.0:1787574336.286462:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574336.286466:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7e3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e33 expref: 22 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286474:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e33 expref: 22 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286485:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7e3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7e33 expref: 22 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286505:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574336.286558:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3634:x1874407346730240:12345-0@lo:103: Request processed in 102us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.286564:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787574336.286578:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787574336.286584:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:3635:x1874407346730368:12345-0@lo:103: 00010000:00010000:1.0:1787574336.286591:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574336.286595:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7e17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e10 expref: 20 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286603:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7e10 expref: 20 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286611:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7e17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7e10 expref: 20 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574336.286621:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574336.286658:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:3635:x1874407346730368:12345-0@lo:103: Request processed in 74us (2198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574336.286664:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574336.286945:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574336.286959:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:3635:x1874407346730880:12345-0@lo:103: 00010000:00010000:2.0:1787574336.286969:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574336.286975:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb7da0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d99 expref: 19 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.286984:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb7da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d99 expref: 19 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.286995:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb7da0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7d99 expref: 19 pid: 6501 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287012:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574336.287045:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:3635:x1874407346730880:12345-0@lo:103: Request processed in 91us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574336.287051:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574336.287068:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787574336.287075:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:3634:x1874407346730752:12345-0@lo:103: 00010000:00010000:2.0:1787574336.287082:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574336.287086:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb7ddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7dd8 expref: 17 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287095:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb7ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7dd8 expref: 17 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287104:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb7ddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7dd8 expref: 17 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287112:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574336.287136:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:3634:x1874407346730752:12345-0@lo:103: Request processed in 63us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574336.287142:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787574336.287156:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:2.0:1787574336.287163:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:2405:x1874407323604224:12345-192.168.202.40@tcp:103: 00010000:00010000:2.0:1787574336.287171:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574336.287175:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb7e9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b501 expref: 11 pid: 6501 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287186:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb7e9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b501 expref: 11 pid: 6501 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287202:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574336.287291:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:2405:x1874407323604224:12345-192.168.202.40@tcp:103: Request processed in 128us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574336.287298:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:2.0:1787574336.287312:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:2.0:1787574336.287319:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2405:x1874407323604352:12345-192.168.202.40@tcp:103: 00010000:00010000:2.0:1787574336.287326:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574336.287330:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7e95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b4fa expref: 10 pid: 6501 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287339:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7e95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b4fa expref: 10 pid: 6501 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287352:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287361:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287378:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287386:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287393:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287399:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287414:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574336.287420:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287428:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287438:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574336.287447:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574336.287466:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2405:x1874407323604352:12345-192.168.202.40@tcp:103: Request processed in 148us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574336.287474:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:1.0:1787574336.287807:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346730368:0@lo:103: 00000100:00100000:1.0:1787574336.287820:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346730880:0@lo:103: 00000100:00100000:1.0:1787574336.287985:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346730112:0@lo:103: 00000100:00100000:1.0:1787574336.287996:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346730624:0@lo:103: 00000100:00100000:1.0:1787574336.288006:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346729984:0@lo:103: 00000100:00100000:1.0:1787574336.288026:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346730496:0@lo:103: 00000100:00100000:1.0:1787574336.288034:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346731008:0@lo:103: 00000100:00100000:0.0:1787574336.288173:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346730240:0@lo:103: 00000100:00100000:0.0:1787574336.288189:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346730752:0@lo:103: 00010000:00010000:3.0:1787574336.288657:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb7e9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b501 expref: 9 pid: 6501 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574336.288789:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346728576:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574336.288807:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7e95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b4fa expref: 8 pid: 6501 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574336.288817:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1874407346728704:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574336.288863:0:10324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574336.288874:0:10324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574336.288880:0:10324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574336.288887:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb7edb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574337.209398:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574337.777534:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574337.777580:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346731136:0@lo:41: 00000100:00100000:0.0:1787574337.777715:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574337.781608:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346731136 00000100:00100000:3.0:1787574337.781638:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346731136 00000100:00100000:3.0:1787574337.781772:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787574337.781788:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346731136:12345-0@lo:41: 00000004:00000024:3.0:1787574337.781850:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787574337.782006:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346731136:12345-0@lo:41: Request processed in 222us (4291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574337.782014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787574337.782115:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346731136:0@lo:41: 00010000:00010000:3.0:1787574338.227735:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574338.292715:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346731648:0@lo:400: 00000100:00100000:1.0:1787574338.292817:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.292889:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346732160:0@lo:400: 00000100:00100000:1.0:1787574338.292918:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.292943:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346732672:0@lo:400: 00000100:00100000:1.0:1787574338.292967:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.292998:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787574338.293004:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346731520:0@lo:400: 00000100:00100000:1.0:1787574338.293032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.293048:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346732032:0@lo:400: 00000100:00100000:1.0:1787574338.293066:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.293081:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346732544:0@lo:400: 00000100:00100000:1.0:1787574338.293101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.293675:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346731392:0@lo:400: 00000100:00100000:3.0:1787574338.293728:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.293761:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346731904:0@lo:400: 00000100:00100000:3.0:1787574338.293786:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.293799:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346732416:0@lo:400: 00000100:00100000:3.0:1787574338.293818:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.293835:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787574338.293841:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346731264:0@lo:400: 00000100:00100000:3.0:1787574338.293874:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.293898:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346731776:0@lo:400: 00000100:00100000:3.0:1787574338.293921:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.293936:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346732288:0@lo:400: 00000100:00100000:3.0:1787574338.293958:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.293978:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346732800:0@lo:400: 00000100:00100000:3.0:1787574338.293998:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.294031:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346732160 00000100:00100000:3.0:1787574338.294040:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346732160 00000100:00100000:3.0:1787574338.294097:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346732672 00000100:00100000:3.0:1787574338.294101:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346732672 00000100:00100000:3.0:1787574338.294138:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346732288 00000100:00100000:3.0:1787574338.294141:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346732288 00000100:00100000:3.0:1787574338.294156:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346732800 00000100:00100000:3.0:1787574338.294159:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346732800 00000100:00100000:3.0:1787574338.294173:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787574338.294182:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346732160:12345-0@lo:400: 00000100:00100000:3.0:1787574338.294283:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346732160:12345-0@lo:400: Request processed in 101us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.294290:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787574338.294308:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787574338.294314:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346732672:12345-0@lo:400: 00000100:00100000:3.0:1787574338.294341:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346732672:12345-0@lo:400: Request processed in 27us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.294347:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787574338.294356:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787574338.294362:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346732288:12345-0@lo:400: 00000100:00100000:3.0:1787574338.294388:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346732288:12345-0@lo:400: Request processed in 27us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.294394:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787574338.294404:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574338.294409:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346732800:12345-0@lo:400: 00000100:00100000:3.0:1787574338.294431:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346732800:12345-0@lo:400: Request processed in 22us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.294435:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787574338.294464:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574338.294469:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574338.294485:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346731520 00000100:00100000:3.0:1787574338.294495:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346731520 00000100:00100000:3.0:1787574338.294525:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346731776 00000100:00100000:3.0:1787574338.294528:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346731776 00000100:00100000:3.0:1787574338.294542:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787574338.294548:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346731520:12345-0@lo:400: 00000100:00100000:3.0:1787574338.294579:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346731520:12345-0@lo:400: Request processed in 32us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.294585:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787574338.294594:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787574338.294598:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346731776:12345-0@lo:400: 00000100:00100000:3.0:1787574338.294621:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346731776:12345-0@lo:400: Request processed in 22us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.294626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787574338.294663:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346731776:0@lo:400: 00010000:00080000:3.0:1787574338.294678:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505880 x1874407346732288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574338.294689:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346732288:0@lo:400: 00010000:00080000:3.0:1787574338.294699:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402504700 x1874407346732800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574338.294707:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346732800:0@lo:400: 00000100:00100000:2.0:1787574338.295036:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346731264 00000100:00100000:2.0:1787574338.295041:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346731264 00000100:00100000:2.0:1787574338.295074:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787574338.295080:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:3635:x1874407346731264:12345-0@lo:400: 00000100:00100000:2.0:1787574338.295122:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:3635:x1874407346731264:12345-0@lo:400: Request processed in 43us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574338.295128:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787574338.295172:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346731264:0@lo:400: 00000100:00100000:0.0:1787574338.295522:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346731648 00000100:00100000:0.0:1787574338.295527:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346731648 00000100:00100000:0.0:1787574338.295552:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346732032 00000100:00100000:0.0:1787574338.295555:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346732032 00000100:00100000:0.0:1787574338.295574:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346732544 00000100:00100000:0.0:1787574338.295578:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346732544 00000100:00100000:0.0:1787574338.295590:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346731392 00000100:00100000:0.0:1787574338.295592:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346731392 00000100:00100000:0.0:1787574338.295603:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346731904 00000100:00100000:0.0:1787574338.295606:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346731904 00000100:00100000:0.0:1787574338.295618:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346732416 00000100:00100000:0.0:1787574338.295630:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346732416 00000100:00100000:0.0:1787574338.295648:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787574338.295654:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346731648:12345-0@lo:400: 00000100:00100000:0.0:1787574338.295706:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346731648:12345-0@lo:400: Request processed in 53us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.295713:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787574338.295725:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787574338.295731:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346732032:12345-0@lo:400: 00000100:00100000:0.0:1787574338.295762:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346732032:12345-0@lo:400: Request processed in 31us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.295767:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787574338.295777:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787574338.295783:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346732544:12345-0@lo:400: 00000100:00100000:0.0:1787574338.295824:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346732544:12345-0@lo:400: Request processed in 41us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.295830:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787574338.295841:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787574338.295847:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346731392:12345-0@lo:400: 00000100:00100000:0.0:1787574338.295876:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346731392:12345-0@lo:400: Request processed in 29us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.295882:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787574338.295893:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787574338.295899:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346731904:12345-0@lo:400: 00000100:00100000:0.0:1787574338.295925:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346731904:12345-0@lo:400: Request processed in 26us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.295931:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787574338.295942:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787574338.295949:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346732416:12345-0@lo:400: 00000100:00100000:0.0:1787574338.295977:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346732416:12345-0@lo:400: Request processed in 29us (2158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.295983:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 10000000:01000000:0.0:1787574338.296017:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787574338.296021:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca53bf11000 from 48 10000000:01000000:0.0:1787574338.296026:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574338.296213:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.296227:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.296360:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574338.296383:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346733056:0@lo:101: 00000100:00100000:0.0:1787574338.296424:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.296576:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346731520:0@lo:400: 00010000:00080000:1.0:1787574338.296592:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402506a00 x1874407346732032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574338.296602:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346732032:0@lo:400: 00010000:00080000:1.0:1787574338.296614:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402507480 x1874407346732544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574338.296634:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346732544:0@lo:400: 00000100:00100000:1.0:1787574338.296660:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346731648:0@lo:400: 00010000:00080000:1.0:1787574338.296672:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505f80 x1874407346732160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574338.296679:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346732160:0@lo:400: 00010000:00080000:1.0:1787574338.296702:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505180 x1874407346732672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574338.296709:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346732672:0@lo:400: 00000100:00100000:1.0:1787574338.296758:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574338.296768:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346732928:0@lo:41: 00000100:00100000:1.0:1787574338.296799:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.296831:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346732928 00000100:00100000:1.0:1787574338.296837:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346732928 00000100:00100000:1.0:1787574338.296865:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787574338.296873:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346732928:12345-0@lo:41: 00000004:00000024:1.0:1787574338.296903:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574338.296944:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346732928:12345-0@lo:41: Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574338.296950:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787574338.296980:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574338.296986:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574338.297132:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.297431:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574338.297443:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346733184:0@lo:13: 00000100:00100000:2.0:1787574338.297569:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346733056 00000100:00100000:2.0:1787574338.297575:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346733056 00000100:00100000:2.0:1787574338.297609:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787574338.297617:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+15:6506:x1874407346733056:12345-0@lo:101: 00010000:00010000:2.0:1787574338.297652:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574338.297675:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82c00/0xd18a1efeeddb7ee9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7ee2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.297716:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82c00/0xd18a1efeeddb7ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7ee2 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.297729:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82c00/0xd18a1efeeddb7ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7ee2 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.297740:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82c00, rc 0) 00000100:00100000:2.0:1787574338.297788:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346733056:12345-0@lo:101: Request processed in 172us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574338.297796:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787574338.297830:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574338.297840:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346733312:0@lo:13: 00000100:00100000:2.0:1787574338.297871:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.297902:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346733312 00000100:00100000:2.0:1787574338.297906:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346733312 00000100:00100000:2.0:1787574338.297937:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787574338.297945:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346733312:12345-0@lo:13: 00002000:00000024:2.0:1787574338.297968:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574338.298006:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346733312:12345-0@lo:13: Request processed in 62us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574338.298013:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787574338.298061:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346731392:0@lo:400: 00000100:00100000:2.0:1787574338.298077:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346731904:0@lo:400: 00000100:00100000:2.0:1787574338.298101:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346732416:0@lo:400: 00000100:00100000:3.0:1787574338.300491:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.300579:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346733184 00000100:00100000:3.0:1787574338.300589:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346733184 00000100:00100000:2.0:1787574338.300828:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346733056:0@lo:101: 00010000:00010000:2.0:1787574338.300860:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.300874:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574338.300969:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346733440:0@lo:501: 00000100:00100000:2.0:1787574338.301006:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.301041:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346733440 00000100:00100000:2.0:1787574338.301045:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346733440 00000100:00100000:2.0:1787574338.301083:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787574338.301095:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346733440:12345-0@lo:501: 00000100:00100000:2.0:1787574338.301232:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346733440:12345-0@lo:501: Request processed in 138us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574338.301257:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787574338.301463:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787574338.301491:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346733184:12345-0@lo:13: 00002000:00000024:3.0:1787574338.301529:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574338.301569:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346733184:12345-0@lo:13: Request processed in 82us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.301576:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574338.302609:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346732928:0@lo:41: 00010000:00080000:2.0:1787574338.304185:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034df480 x1874407346733312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574338.304213:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346733312:0@lo:13: 00010000:00080000:3.0:1787574338.305941:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402690000 x1874407346733184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574338.305969:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346733184:0@lo:13: 00000100:00100000:2.0:1787574338.306062:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574338.306081:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346733440:0@lo:501: 00000100:00100000:2.0:1787574338.306151:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346733568:0@lo:503: 00000100:00100000:2.0:1787574338.306337:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.306381:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.306603:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346733568 00000100:00100000:0.0:1787574338.306762:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346733568 00000100:00100000:0.0:1787574338.306829:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787574338.306840:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346733568:12345-0@lo:503: 00000100:00100000:0.0:1787574338.307395:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346733568:12345-0@lo:503: Request processed in 553us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.307404:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787574338.313860:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346733568:0@lo:503: 00000100:00100000:0.0:1787574338.319172:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504592680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10342:1874407346733696:0@lo:502: 00000100:00100000:0.0:1787574338.319423:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574338.319501:0:10342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.319950:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346733696 00000100:00100000:3.0:1787574338.319961:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346733696 00000100:00100000:3.0:1787574338.320033:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787574338.320045:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:10342:x1874407346733696:12345-0@lo:502: 00000100:00100000:3.0:1787574338.320633:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:10342:x1874407346733696:12345-0@lo:502: Request processed in 576us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.320643:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787574338.320990:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504592680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10342:1874407346733696:0@lo:502: 00000100:00100000:0.0:1787574338.321163:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10342:1874407346733824:0@lo:502: 00000100:00100000:0.0:1787574338.321221:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574338.321393:0:10342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574338.321435:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346733824 00000100:00100000:2.0:1787574338.321443:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346733824 00000100:00100000:2.0:1787574338.321856:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787574338.321868:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:10342:x1874407346733824:12345-0@lo:502: 00000100:00100000:2.0:1787574338.322031:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:10342:x1874407346733824:12345-0@lo:502: Request processed in 165us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574338.322039:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787574338.322130:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10342:1874407346733824:0@lo:502: 00000040:00080000:1.0:1787574338.322167:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787574338.322572:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787574338.322608:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787574338.322630:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.322645:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574338.322657:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787574338.322660:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787574338.322664:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787574338.322719:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.322735:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.322745:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574338.322765:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346733952:0@lo:101: 00000100:00100000:3.0:1787574338.322809:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.324158:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.324604:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346733952 00000100:00100000:0.0:1787574338.324629:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346733952 00000100:00100000:0.0:1787574338.324703:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787574338.324716:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+16:6506:x1874407346733952:12345-0@lo:101: 00010000:00010000:0.0:1787574338.324737:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574338.324761:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca535c11400/0xd18a1efeeddb7ef7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7ef0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.324822:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c11400/0xd18a1efeeddb7ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7ef0 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.324835:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca535c11400/0xd18a1efeeddb7ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7ef0 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.324846:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11400, rc 0) 00000100:00100000:0.0:1787574338.324923:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346733952:12345-0@lo:101: Request processed in 209us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.324931:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787574338.325099:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346733952:0@lo:101: 00010000:00010000:3.0:1787574338.325120:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.325131:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574338.325219:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346734080:0@lo:501: 00000100:00100000:3.0:1787574338.325288:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.325317:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.325430:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346734080 00000100:00100000:0.0:1787574338.325434:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346734080 00000100:00100000:0.0:1787574338.325470:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787574338.325478:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346734080:12345-0@lo:501: 00000100:00100000:0.0:1787574338.325918:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346734080:12345-0@lo:501: Request processed in 439us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.325927:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787574338.326018:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346734080:0@lo:501: 00000100:00100000:3.0:1787574338.326053:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346734208:0@lo:503: 00000100:00100000:3.0:1787574338.326106:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.326137:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.326213:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346734208 00000100:00100000:0.0:1787574338.326219:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346734208 00000100:00100000:2.0:1787574338.326421:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787574338.326433:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346734208:12345-0@lo:503: 00000100:00100000:2.0:1787574338.326563:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346734208:12345-0@lo:503: Request processed in 133us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574338.326570:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787574338.327020:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346734208:0@lo:503: 00000100:00100000:0.0:1787574338.328093:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10343:1874407346734336:0@lo:502: 00000100:00100000:0.0:1787574338.328170:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574338.330833:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509b72180 going to sleep for 11 seconds 00000100:00100000:2.0:1787574338.332810:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346734336 00000100:00100000:2.0:1787574338.332829:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346734336 00000100:00100000:2.0:1787574338.332916:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787574338.332925:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:10343:x1874407346734336:12345-0@lo:502: 00000100:00100000:2.0:1787574338.333151:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:10343:x1874407346734336:12345-0@lo:502: Request processed in 227us (4981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574338.333158:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787574338.333584:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10343:1874407346734336:0@lo:502: 00000020:01000000:0.0:1787574338.334354:0:10343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574338.334373:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574338.334376:0:10343:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787574338.334383:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787574338.334443:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10343:1874407346734464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574338.334525:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574338.334568:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509b72180 going to sleep for 11 seconds 00000100:00100000:2.0:1787574338.335379:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346734464 00000100:00100000:2.0:1787574338.335391:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346734464 00000100:00100000:0.0:1787574338.335606:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787574338.335633:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:10343:x1874407346734464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574338.335840:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:10343:x1874407346734464:12345-0@lo:502:llog_process_th.0 Request processed in 222us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.335849:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787574338.336080:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10343:1874407346734464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574338.336123:0:10343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574338.336132:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574338.336135:0:10343:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787574338.336140:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1787574338.336366:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787574338.336404:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787574338.336419:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.336433:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574338.336447:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787574338.336451:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca53bc3a000 from 48 10000000:01000000:3.0:1787574338.336455:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787574338.336499:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.336520:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.336530:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574338.336554:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346734592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.336597:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.336649:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5202490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.336968:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346734592 00000100:00100000:0.0:1787574338.336975:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346734592 00000100:00100000:0.0:1787574338.337027:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787574338.337036:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+17:6506:x1874407346734592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574338.337050:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574338.337065:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca535c10400/0xd18a1efeeddb7f05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7efe expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.337092:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c10400/0xd18a1efeeddb7f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7efe expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.337103:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca535c10400/0xd18a1efeeddb7f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7efe expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.337113:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10400, rc 0) 00000100:00100000:0.0:1787574338.337159:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346734592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.337165:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787574338.337386:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346734592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574338.337403:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.337412:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574338.337487:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346734720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.337542:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.337573:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5202490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.337857:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346734720 00000100:00100000:0.0:1787574338.337863:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346734720 00000100:00100000:0.0:1787574338.337941:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787574338.337949:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346734720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574338.338098:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346734720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.338107:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787574338.338167:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346734720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.338199:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346734848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.338706:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.347052:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5202490c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574338.355089:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346734848 00000100:00100000:1.0:1787574338.355118:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346734848 00000100:00100000:1.0:1787574338.355229:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787574338.355271:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346734848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574338.355533:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346734848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 292us (16825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574338.355542:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787574338.357065:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346734848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574338.358129:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10344:1874407346734976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574338.358226:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.358307:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.358409:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346734976 00000100:00100000:3.0:1787574338.358417:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346734976 00000100:00100000:3.0:1787574338.358462:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787574338.358474:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:10344:x1874407346734976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574338.358655:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:10344:x1874407346734976:12345-0@lo:502:llog_process_th.0 Request processed in 183us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.358664:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787574338.359531:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10344:1874407346734976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574338.359604:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10344:1874407346735104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574338.359669:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.359810:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.359983:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346735104 00000100:00100000:3.0:1787574338.359989:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346735104 00000100:00100000:3.0:1787574338.360022:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787574338.360030:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:10344:x1874407346735104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574338.360152:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:10344:x1874407346735104:12345-0@lo:502:llog_process_th.0 Request processed in 121us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.360160:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787574338.361879:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10344:1874407346735104:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787574338.361926:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787574338.362183:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787574338.362211:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787574338.362225:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.362308:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574338.362320:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787574338.362323:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787574338.362326:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787574338.362366:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.362374:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.362384:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574338.362410:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346735232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.362477:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.362527:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5031a3480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.362552:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346735232 00000100:00100000:3.0:1787574338.362559:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346735232 00000100:00100000:3.0:1787574338.362597:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787574338.362607:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+18:6506:x1874407346735232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574338.362872:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574338.362889:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be99000/0xd18a1efeeddb7f13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7f0c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.362918:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be99000/0xd18a1efeeddb7f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f0c expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.362941:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be99000/0xd18a1efeeddb7f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f0c expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.362950:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99000, rc 0) 00000100:00100000:3.0:1787574338.362999:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346735232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 393us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.363007:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787574338.363089:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346735232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574338.363106:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574338.363121:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574338.363183:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346735360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574338.363211:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.363267:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.363360:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346735360 00000100:00100000:0.0:1787574338.363366:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346735360 00000100:00100000:0.0:1787574338.363394:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787574338.363401:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346735360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574338.363562:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346735360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.363570:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787574338.364142:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346735360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574338.364181:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346735488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574338.364341:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.364369:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.364418:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346735488 00000100:00100000:0.0:1787574338.364423:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346735488 00000100:00100000:0.0:1787574338.364456:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787574338.364464:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346735488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574338.364790:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346735488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 326us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.364798:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787574338.371111:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346735488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574338.372287:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10345:1874407346735616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574338.372399:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574338.372469:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.372612:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346735616 00000100:00100000:3.0:1787574338.372632:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346735616 00000100:00100000:3.0:1787574338.372868:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787574338.372882:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:10345:x1874407346735616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574338.373054:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:10345:x1874407346735616:12345-0@lo:502:llog_process_th.0 Request processed in 175us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.373063:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787574338.374047:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10345:1874407346735616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787574338.374097:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574338.374112:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574338.374114:0:10345:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787574338.374130:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787574338.374176:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10345:1874407346735744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574338.374234:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574338.374333:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574338.374618:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346735744 00000100:00100000:1.0:1787574338.374635:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346735744 00000100:00100000:1.0:1787574338.374803:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787574338.374814:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:10345:x1874407346735744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574338.374957:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:10345:x1874407346735744:12345-0@lo:502:llog_process_th.0 Request processed in 144us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574338.374964:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787574338.375039:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10345:1874407346735744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787574338.375061:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574338.375066:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574338.375068:0:10345:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787574338.375072:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1787574338.378718:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787574338.378774:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787574338.378792:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.378808:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574338.378849:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787574338.378853:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca526758000 from 48 10000000:01000000:2.0:1787574338.378855:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787574338.378909:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.378918:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.378930:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574338.378961:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346735872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.379054:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.388930:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.394603:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346735872 00000100:00100000:3.0:1787574338.394699:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346735872 00000100:00100000:3.0:1787574338.394797:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787574338.394811:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:6506:x1874407346735872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574338.394834:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574338.394859:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be99200/0xd18a1efeeddb7f21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7f1a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.394895:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be99200/0xd18a1efeeddb7f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f1a expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.394907:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be99200/0xd18a1efeeddb7f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f1a expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.394942:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99200, rc 0) 00000100:00100000:3.0:1787574338.395447:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346735872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 636us (16389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.395456:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787574338.395807:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346735872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574338.395837:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.395850:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574338.395955:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346736000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.396015:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.396049:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.396817:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346736000 00000100:00100000:3.0:1787574338.396827:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346736000 00000100:00100000:3.0:1787574338.396874:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787574338.396884:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346736000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.397893:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346736000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1004us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.397906:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787574338.398348:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346736000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.398412:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346736128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.398491:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.398585:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.399913:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346736128 00000100:00100000:0.0:1787574338.399929:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346736128 00000100:00100000:1.0:1787574338.401079:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787574338.401989:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346736128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.402229:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346736128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1134us (3737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574338.402278:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787574338.402477:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346736128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.419976:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10346:1874407346736256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574338.420106:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.420220:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787574338.422050:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346736256 00000100:00100000:2.0:1787574338.422069:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346736256 00000100:00100000:2.0:1787574338.422148:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787574338.422161:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:10346:x1874407346736256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574338.422413:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:10346:x1874407346736256:12345-0@lo:502:llog_process_th.0 Request processed in 253us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574338.422422:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787574338.422646:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10346:1874407346736256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574338.422745:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10346:1874407346736384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574338.422798:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.422832:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.423094:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346736384 00000100:00100000:0.0:1787574338.423101:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346736384 00000100:00100000:0.0:1787574338.423151:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787574338.423161:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:10346:x1874407346736384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574338.423343:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:10346:x1874407346736384:12345-0@lo:502:llog_process_th.0 Request processed in 183us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.423351:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787574338.423585:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10346:1874407346736384:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787574338.423606:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787574338.426673:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787574338.426788:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574338.426805:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.426820:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574338.426834:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787574338.426838:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1787574338.426842:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787574338.426967:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.426976:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.427013:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574338.427048:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346736512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.427139:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.427228:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.430534:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346736512 00000100:00100000:0.0:1787574338.430558:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346736512 00000100:00100000:0.0:1787574338.430641:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787574338.430654:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346736512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574338.430678:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574338.430718:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7f2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7f28 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.430758:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f28 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.430795:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f28 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.430806:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11e00, rc 0) 00000100:00100000:0.0:1787574338.431036:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346736512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 384us (3895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.431044:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787574338.431160:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346736512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574338.431186:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574338.431197:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574338.431355:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346736640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574338.431393:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.431435:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.431557:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346736640 00000100:00100000:0.0:1787574338.431563:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346736640 00000100:00100000:0.0:1787574338.431797:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787574338.431806:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346736640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574338.431974:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346736640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.431982:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787574338.432101:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346736640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.432139:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402693800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346736768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.432186:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.436205:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574338.439492:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346736768 00000100:00100000:1.0:1787574338.439523:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346736768 00000100:00100000:0.0:1787574338.442553:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787574338.442573:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346736768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574338.443052:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346736768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 482us (10864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.443062:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787574338.451481:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402693800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346736768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.452827:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402693800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10347:1874407346736896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574338.453073:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.453177:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.455398:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346736896 00000100:00100000:0.0:1787574338.455418:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346736896 00000100:00100000:0.0:1787574338.455540:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787574338.455553:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:10347:x1874407346736896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574338.456104:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:10347:x1874407346736896:12345-0@lo:502:llog_process_th.0 Request processed in 552us (3030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.456124:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787574338.464462:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402693800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10347:1874407346736896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574338.464539:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574338.464557:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574338.464559:0:10347:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787574338.464567:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787574338.464614:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402693800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10347:1874407346737024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574338.465074:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.465151:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.469055:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346737024 00000100:00100000:0.0:1787574338.469080:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346737024 00000100:00100000:2.0:1787574338.469371:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787574338.469387:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:10347:x1874407346737024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574338.469660:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:10347:x1874407346737024:12345-0@lo:502:llog_process_th.0 Request processed in 276us (4587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574338.469670:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787574338.470004:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402693800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10347:1874407346737024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574338.470049:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574338.470059:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574338.470062:0:10347:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787574338.470067:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1787574338.471315:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1787574338.471353:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787574338.471367:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.471382:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574338.471396:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787574338.471399:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca5109bd800 from 48 10000000:01000000:2.0:1787574338.471403:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787574338.471450:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.471461:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.471491:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574338.471532:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346737152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.471607:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.471672:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.471889:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346737152 00000100:00100000:0.0:1787574338.471899:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346737152 00000100:00100000:0.0:1787574338.471947:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787574338.471969:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346737152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574338.471984:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574338.472000:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7f3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7f36 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.472029:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f36 expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.472040:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f36 expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.472050:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10e00, rc 0) 00000100:00100000:0.0:1787574338.472104:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346737152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.472112:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787574338.473200:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346737152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574338.473226:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.473291:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574338.473386:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346737280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.473442:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.473478:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787574338.475795:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346737280 00000100:00100000:0.0:1787574338.475817:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346737280 00000100:00100000:0.0:1787574338.475907:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787574338.475918:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346737280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574338.476178:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346737280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (2735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.476187:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787574338.477225:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346737280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.477340:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346737408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.477423:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.477462:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.477733:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346737408 00000100:00100000:3.0:1787574338.477742:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346737408 00000100:00100000:3.0:1787574338.477789:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787574338.477799:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346737408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.477945:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346737408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.477955:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787574338.479361:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346737408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.481129:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10348:1874407346737536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574338.481231:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.481314:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.481544:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346737536 00000100:00100000:3.0:1787574338.481552:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346737536 00000100:00100000:3.0:1787574338.481605:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787574338.481615:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:10348:x1874407346737536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574338.481813:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:10348:x1874407346737536:12345-0@lo:502:llog_process_th.0 Request processed in 198us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.481831:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787574338.485442:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10348:1874407346737536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574338.485570:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10348:1874407346737664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574338.485680:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.485729:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.486400:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346737664 00000100:00100000:3.0:1787574338.486411:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346737664 00000100:00100000:3.0:1787574338.486474:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787574338.486486:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:10348:x1874407346737664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574338.486690:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:10348:x1874407346737664:12345-0@lo:502:llog_process_th.0 Request processed in 204us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.486699:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787574338.487697:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10348:1874407346737664:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787574338.487745:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787574338.488390:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787574338.488420:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787574338.488434:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.488447:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574338.488460:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787574338.488463:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1787574338.488466:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787574338.488526:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.488535:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.488547:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574338.488573:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402693800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346737792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.488676:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574338.488729:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787574338.488869:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346737792 00000100:00100000:1.0:1787574338.488879:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346737792 00000100:00100000:1.0:1787574338.488943:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787574338.488955:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346737792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574338.488979:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574338.488996:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7f4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7f44 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574338.489026:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f44 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574338.489038:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f44 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574338.489059:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74600, rc 0) 00000100:00100000:1.0:1787574338.489109:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346737792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574338.489116:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787574338.489576:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402693800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346737792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574338.489595:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574338.489606:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574338.489705:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346737920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574338.489738:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.489768:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574338.490093:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346737920 00000100:00100000:1.0:1787574338.490100:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346737920 00000100:00100000:1.0:1787574338.490139:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787574338.490148:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346737920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574338.490337:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346737920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574338.490345:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787574338.490474:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346737920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574338.490553:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346738048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574338.490604:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574338.490642:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.491031:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346738048 00000100:00100000:3.0:1787574338.491037:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346738048 00000100:00100000:3.0:1787574338.491064:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787574338.491072:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346738048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.491168:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346738048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.491175:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787574338.494827:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346738048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574338.495915:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10349:1874407346738176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574338.496130:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.496184:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.497347:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346738176 00000100:00100000:3.0:1787574338.497364:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346738176 00000100:00100000:3.0:1787574338.497439:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787574338.497451:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:10349:x1874407346738176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574338.497664:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:10349:x1874407346738176:12345-0@lo:502:llog_process_th.0 Request processed in 215us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.497673:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787574338.497922:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10349:1874407346738176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574338.498115:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574338.498128:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574338.498131:0:10349:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787574338.498137:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787574338.498181:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10349:1874407346738304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574338.498234:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574338.498400:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4024d6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574338.498523:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346738304 00000100:00100000:1.0:1787574338.498531:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346738304 00000100:00100000:1.0:1787574338.498571:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787574338.498581:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:10349:x1874407346738304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574338.498693:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:10349:x1874407346738304:12345-0@lo:502:llog_process_th.0 Request processed in 113us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574338.498701:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787574338.498904:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10349:1874407346738304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574338.498938:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574338.498943:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574338.498944:0:10349:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787574338.498948:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787574338.500654:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1787574338.500694:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787574338.500710:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.500761:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574338.500776:0:6506:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787574338.500779:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ca5050d4d28 from 1 10000000:01000000:0.0:1787574338.500783:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787574338.500834:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.500844:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.500863:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574338.500894:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346738432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574338.501429:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574338.501491:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.501607:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346738432 00000100:00100000:3.0:1787574338.501618:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346738432 00000100:00100000:3.0:1787574338.501677:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787574338.501689:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346738432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574338.501705:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574338.501723:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be99c00/0xd18a1efeeddb7f59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7f52 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.501755:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be99c00/0xd18a1efeeddb7f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f52 expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.501782:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be99c00/0xd18a1efeeddb7f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f52 expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574338.501793:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99c00, rc 0) 00000100:00100000:3.0:1787574338.501847:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346738432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.501855:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787574338.505111:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346738432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574338.505162:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7f52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f59 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574338.505178:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7f52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f59 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574338.506642:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346738560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574338.506759:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574338.506815:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787574338.507418:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346738560 00000100:00100000:3.0:1787574338.507430:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346738560 00000100:00100000:3.0:1787574338.507497:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787574338.507519:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346738560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574338.507638:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346738560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (879us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574338.507646:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787574338.507774:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346738560:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787574338.507831:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787574338.507845:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7f52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f59 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574338.507869:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f59 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574338.826822:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574338.826888:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574338.826928:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574338.826950:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574338.826986:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574338.827016:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323604608 00000100:00100000:0.0:1787574338.827026:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323604608 00000100:00100000:0.0:1787574338.827086:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323604736 00000100:00100000:0.0:1787574338.827089:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323604736 00000100:00100000:0.0:1787574338.827115:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:0.0:1787574338.827125:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323604608:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1787574338.827197:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323604608:12345-192.168.202.40@tcp:400: Request processed in 74us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.827205:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:0.0:1787574338.827221:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:0.0:1787574338.827227:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323604736:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1787574338.827280:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323604736:12345-192.168.202.40@tcp:400: Request processed in 53us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574338.827286:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:3.0:1787574338.827451:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323604864 00000100:00100000:3.0:1787574338.827455:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323604864 00000100:00100000:3.0:1787574338.827490:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323604992 00000100:00100000:3.0:1787574338.827494:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323604992 00000100:00100000:3.0:1787574338.827533:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1787574338.827541:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323604864:12345-192.168.202.40@tcp:400: 00000100:00100000:3.0:1787574338.827578:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323604864:12345-192.168.202.40@tcp:400: Request processed in 38us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.827585:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1787574338.827598:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:3.0:1787574338.827604:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323604992:12345-192.168.202.40@tcp:400: 00000100:00100000:3.0:1787574338.827644:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323604992:12345-192.168.202.40@tcp:400: Request processed in 40us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574338.827651:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00080000:1.0:1787574338.830032:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574338.830042:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574338.830046:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574338.830049:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574338.831123:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323604480 00000100:00100000:2.0:1787574338.831141:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323604480 00000100:00100000:2.0:1787574338.831216:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 245 00000100:00100000:2.0:1787574338.831228:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:2404:x1874407323604480:12345-192.168.202.40@tcp:400: 00000100:00100000:2.0:1787574338.831329:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:2404:x1874407323604480:12345-192.168.202.40@tcp:400: Request processed in 103us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574338.831337:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 245 00010000:00010000:1.0:1787574339.249475:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574340.276671:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574341.298160:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574341.363180:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574341.363224:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346738688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574341.363331:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574341.363596:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346738688 00000100:00100000:3.0:1787574341.363605:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346738688 00000100:00100000:3.0:1787574341.363669:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787574341.363680:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346738688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574341.363710:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574341.363771:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346738688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574341.363778:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787574341.363984:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574341.363995:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346738816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574341.364028:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787574341.364132:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402691c00 x1874407346738688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574341.364150:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346738688:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787574341.364171:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574341.364421:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346738816 00000100:00100000:3.0:1787574341.364426:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346738816 00000100:00100000:3.0:1787574341.364472:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787574341.364492:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346738816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574341.364505:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574341.364549:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346738816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574341.364557:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787574341.365154:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4019ec700 x1874407346738816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574341.365167:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346738816:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787574341.366061:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574341.897651:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574341.897960:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323605120 00000100:00100000:3.0:1787574341.897970:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323605120 00000100:00100000:3.0:1787574341.898040:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 246 00000100:00100000:3.0:1787574341.898050:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:6179:x1874407323605120:12345-192.168.202.40@tcp:101: 00010000:00010000:3.0:1787574341.898066:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574341.898085:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be98000/0xd18a1efeeddb7f60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b571 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574341.898120:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be98000/0xd18a1efeeddb7f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b571 expref: 9 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574341.898131:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be98000/0xd18a1efeeddb7f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b571 expref: 9 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574341.898554:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be98000, rc 0) 00000100:00100000:3.0:1787574341.898622:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6179:x1874407323605120:12345-192.168.202.40@tcp:101: Request processed in 573us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574341.898630:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 246 00000100:00100000:2.0:1787574341.906064:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574341.907204:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323605248 00000100:00100000:1.0:1787574341.907220:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323605248 00000100:00100000:1.0:1787574341.907317:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 247 00000100:00100000:1.0:1787574341.907328:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6179:x1874407323605248:12345-192.168.202.40@tcp:501: 00000100:00100000:1.0:1787574341.909523:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6179:x1874407323605248:12345-192.168.202.40@tcp:501: Request processed in 1801us (3993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574341.909537:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 247 00000100:00100000:1.0:1787574341.915748:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574341.923405:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323605376 00000100:00100000:3.0:1787574341.923421:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323605376 00000100:00100000:3.0:1787574341.923504:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 248 00000100:00100000:3.0:1787574341.923515:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6179:x1874407323605376:12345-192.168.202.40@tcp:503: 00000100:00100000:3.0:1787574341.923694:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6179:x1874407323605376:12345-192.168.202.40@tcp:503: Request processed in 179us (8030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574341.923701:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 248 00000100:00100000:0.0:1787574341.931944:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574341.932062:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323605504 00000100:00100000:1.0:1787574341.932073:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323605504 00000100:00100000:1.0:1787574341.932150:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 249 00000100:00100000:1.0:1787574341.932161:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6677:x1874407323605504:12345-192.168.202.40@tcp:502: 00000100:00100000:1.0:1787574341.932375:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6677:x1874407323605504:12345-192.168.202.40@tcp:502: Request processed in 214us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574341.932385:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 249 00000100:00100000:0.0:1787574341.938090:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574341.938962:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323605632 00000100:00100000:2.0:1787574341.938976:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323605632 00000100:00100000:2.0:1787574341.939052:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 250 00000100:00100000:2.0:1787574341.939062:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6677:x1874407323605632:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574341.939229:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6677:x1874407323605632:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 167us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574341.939290:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 250 00000100:00100000:2.0:1787574341.954888:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574341.955608:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323605760 00000100:00100000:3.0:1787574341.955618:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323605760 00000100:00100000:3.0:1787574341.955723:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 251 00000100:00100000:3.0:1787574341.955737:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6179:x1874407323605760:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574341.955757:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574341.955786:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be98200/0xd18a1efeeddb7f67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b578 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574341.955813:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be98200/0xd18a1efeeddb7f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b578 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574341.955841:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be98200/0xd18a1efeeddb7f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b578 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574341.955862:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be98200, rc 0) 00000100:00100000:3.0:1787574341.955932:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6179:x1874407323605760:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 198us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574341.955938:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 251 00000100:00100000:0.0:1787574341.978570:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574341.979464:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323605888 00000100:00100000:1.0:1787574341.979487:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323605888 00000100:00100000:1.0:1787574341.979561:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 252 00000100:00100000:1.0:1787574341.979573:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6179:x1874407323605888:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574341.979778:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6179:x1874407323605888:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 206us (1218us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787574341.979787:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 252 00010000:00010000:0.0:1787574342.326381:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574342.900079:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574342.900171:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346738944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574342.900312:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574342.901547:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346738944 00000100:00100000:0.0:1787574342.901561:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346738944 00000100:00100000:0.0:1787574342.901664:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787574342.901681:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346738944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574342.901730:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574342.901813:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346738944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574342.901835:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787574342.901946:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346738944:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787574343.346061:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574343.409649:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574343.409672:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346739072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574343.409747:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574343.409814:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346739072 00000100:00100000:1.0:1787574343.409823:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346739072 00000100:00100000:1.0:1787574343.409865:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574343.409873:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346739072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574343.409914:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574343.410163:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346739072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 289us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.410171:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574343.410199:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346739456:0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.410229:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574343.419673:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346739200:0@lo:400:kworker.0 00000100:00100000:2.0:1787574343.419768:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574343.419836:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346739712:0@lo:400:kworker.0 00000100:00100000:2.0:1787574343.419864:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574343.419886:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346740224:0@lo:400:kworker.0 00000100:00100000:2.0:1787574343.419909:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574343.419937:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787574343.419944:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346739328:0@lo:400:kworker.0 00000100:00100000:2.0:1787574343.420119:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574343.420219:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346739840:0@lo:400:kworker.0 00000100:00100000:2.0:1787574343.420265:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574343.420279:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346740352:0@lo:400:kworker.0 00000100:00100000:2.0:1787574343.420317:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574343.420976:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346739072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574343.421000:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346739968:0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.421032:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574343.421052:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346740480:0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.421068:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574343.421083:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787574343.421090:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346739584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574343.421114:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574343.421132:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346740096:0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.421164:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574343.421180:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346740608:0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.421205:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574343.421254:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346739456 00000100:00100000:1.0:1787574343.421261:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346739456 00000100:00100000:1.0:1787574343.421295:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346739712 00000100:00100000:1.0:1787574343.421298:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346739712 00000100:00100000:1.0:1787574343.421317:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346740224 00000100:00100000:1.0:1787574343.421320:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346740224 00000100:00100000:1.0:1787574343.421330:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346739328 00000100:00100000:1.0:1787574343.421332:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346739328 00000100:00100000:1.0:1787574343.421354:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346739840 00000100:00100000:1.0:1787574343.421357:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346739840 00000100:00100000:1.0:1787574343.421370:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346740352 00000100:00100000:1.0:1787574343.421384:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346740352 00000100:00100000:1.0:1787574343.421400:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787574343.421692:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346739200 00000100:00100000:2.0:1787574343.421697:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346739200 00000100:00100000:2.0:1787574343.421727:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787574343.421735:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346739200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574343.421780:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346739200:12345-0@lo:400:kworker.0 Request processed in 46us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574343.421787:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787574343.421895:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346739456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574343.422259:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787574343.422273:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346739712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574343.422632:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346740736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574343.423388:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346739968 00000100:00100000:0.0:1787574343.423396:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346739968 00000100:00100000:0.0:1787574343.423438:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346740480 00000100:00100000:0.0:1787574343.423441:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346740480 00000100:00100000:0.0:1787574343.423455:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346740096 00000100:00100000:0.0:1787574343.423468:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346740096 00000100:00100000:0.0:1787574343.423488:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346740608 00000100:00100000:0.0:1787574343.423491:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346740608 00000100:00100000:0.0:1787574343.423506:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574343.423514:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346739968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.428453:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346739456:12345-0@lo:400:kworker.0 Request processed in 6550us (18212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.428478:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787574343.428525:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787574343.428549:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346740224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.428606:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346740224:12345-0@lo:400:kworker.0 Request processed in 64us (8697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.428613:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787574343.428624:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787574343.428631:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346739328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.428659:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346739328:12345-0@lo:400:kworker.0 Request processed in 29us (8540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.428665:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787574343.428678:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787574343.428684:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346739840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.428711:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346739840:12345-0@lo:400:kworker.0 Request processed in 28us (8446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.428717:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787574343.428728:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787574343.428734:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346740352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.428775:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346740352:12345-0@lo:400:kworker.0 Request processed in 42us (8459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.428781:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787574343.428826:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346739584 00000100:00100000:1.0:1787574343.428835:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346739584 00000100:00100000:1.0:1787574343.428872:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787574343.428878:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346739584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574343.428899:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574343.428929:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346739584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (7815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.428935:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787574343.428965:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574343.428973:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346740480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.428999:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346740480:12345-0@lo:400:kworker.0 Request processed in 27us (7930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.429004:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574343.429016:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574343.429021:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346740096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.429043:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346740096:12345-0@lo:400:kworker.0 Request processed in 22us (7879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.429049:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574343.429057:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787574343.429062:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346740608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.429081:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346740608:12345-0@lo:400:kworker.0 Request processed in 20us (7876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.429096:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787574343.429151:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402693480 x1874407346739584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574343.429173:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346739584:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787574343.429187:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034ddf80 x1874407346740096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574343.429194:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346740096:0@lo:400:kworker.0 00010000:00080000:1.0:1787574343.429204:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034de680 x1874407346740608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574343.429212:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346740608:0@lo:400:kworker.0 00010000:00080000:1.0:1787574343.429222:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034dc380 x1874407346740480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574343.429230:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346740480:0@lo:400:kworker.0 00000100:00100000:1.0:1787574343.429264:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346739456:0@lo:400:kworker.0 00000100:00100000:2.0:1787574343.444931:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346739712:12345-0@lo:400:kworker.0 Request processed in 22650us (25056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574343.444947:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787574343.444997:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574343.445002:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574343.445006:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574343.445008:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574343.447927:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574343.448027:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346739328:0@lo:400:kworker.0 00010000:00080000:3.0:1787574343.448049:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034dd180 x1874407346739840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574343.448061:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346739840:0@lo:400:kworker.0 00010000:00080000:3.0:1787574343.448075:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034dc700 x1874407346740352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574343.448084:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346740352:0@lo:400:kworker.0 00000100:00100000:3.0:1787574343.448095:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346739200:0@lo:400:kworker.0 00000100:00100000:3.0:1787574343.448108:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346739712:0@lo:400:kworker.0 00000100:00100000:3.0:1787574343.448119:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346740224:0@lo:400:kworker.0 00000100:00100000:0.0:1787574343.451598:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346739968:12345-0@lo:400:kworker.0 Request processed in 28075us (30556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574343.451615:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787574343.452002:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034dd880 x1874407346739968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574343.452017:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346739968:0@lo:400:kworker.0 00000100:00100000:2.0:1787574343.467299:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346740736 00000100:00100000:2.0:1787574343.467314:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346740736 00000100:00100000:2.0:1787574343.467374:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574343.467385:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346740736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574343.467427:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574343.467524:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346740736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (19606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574343.467532:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787574343.469498:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40345d500 x1874407346740736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574343.469540:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346740736:0@lo:13:osp-pre-1-1.0 00000020:00000080:2.0:1787574343.531422:0:10386:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff88449540 20000000:00000080:2.0:1787574343.531446:0:10386:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ca403593800 uarg=0000000000000000 20000000:01000000:2.0:1787574343.531503:0:10386:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787574343.531508:0:10386:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787574343.531514:0:10386:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787574343.533232:0:10387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787574343.533418:0:10386:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787574343.535634:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787574343.535672:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787574343.535686:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787574343.535705:0:10386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787574343.535734:0:10386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.535756:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be75000/0xd18a1efeeddb7c0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c03 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.535780:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb7c18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c11 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.535788:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb7c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7c65 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.535796:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd83000/0xd18a1efeeddb7d92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7d8b expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.535805:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be74e00/0xd18a1efeeddb7eaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b539 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.535814:0:10386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.535863:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be74e00/0xd18a1efeeddb7eaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b539 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.535880:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53be74e00/0xd18a1efeeddb7eaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b539 expref: 9 pid: 6504 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574343.535896:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874407346740864:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574343.536019:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd83000/0xd18a1efeeddb7d92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7d8b expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.536028:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53bd83000/0xd18a1efeeddb7d92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d8b expref: 23 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574343.536039:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874407346740992:0@lo:104: 00000100:00100000:2.0:1787574343.536085:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574343.536123:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb7c6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7c65 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.536132:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb7c6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c65 expref: 23 pid: 6503 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574343.536141:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874407346741120:0@lo:104: 00000100:00100000:2.0:1787574343.536161:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574343.536200:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787574343.536211:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346740992 00000100:00100000:2.0:1787574343.536218:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346740992 00000100:00100000:2.0:1787574343.536283:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346741120 00000100:00100000:2.0:1787574343.536287:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346741120 00000100:00100000:2.0:1787574343.536302:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574343.536311:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:10386:x1874407346740992:12345-0@lo:104: 00010000:00010000:2.0:1787574343.536322:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.536362:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787574343.536367:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:10386:x1874407346740992:12345-0@lo:104: Request processed in 57us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574343.536374:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574343.536388:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787574343.536394:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f442450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:10386:x1874407346741120:12345-0@lo:104: 00010000:00010000:2.0:1787574343.536400:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.536425:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787574343.536436:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f442450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:10386:x1874407346741120:12345-0@lo:104: Request processed in 42us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574343.536442:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1787574343.537838:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574343.537847:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.537872:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574343.537876:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.537887:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574343.537895:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574343.537901:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574343.537938:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.537944:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574343.537965:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.537972:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb7d8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7d92 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.537986:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574343.537989:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.537995:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030c00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574343.537998:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.538014:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574343.538020:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574343.538026:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574343.538038:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.538044:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574343.538057:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.538064:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb7c65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c6c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.538074:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574343.538075:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574343.538077:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574343.538091:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346741248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574343.538133:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574343.538198:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346741376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574343.538220:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574343.538268:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346741248 00000100:00100000:0.0:1787574343.538274:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346741248 00010000:00010000:0.0:1787574343.538299:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd83000/0xd18a1efeeddb7d92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d8b expref: 24 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574343.538331:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346741376 00000100:00100000:0.0:1787574343.538335:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346741376 00010000:00010000:0.0:1787574343.538345:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb7c6c lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c65 expref: 25 pid: 6503 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574343.538362:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574343.538376:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504592680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+25:3635:x1874407346741248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574343.538387:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574343.538392:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd83000/0xd18a1efeeddb7d92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d8b expref: 25 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.538402:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd83000/0xd18a1efeeddb7d92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7d8b expref: 25 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.538418:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574343.538445:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504592680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+25:3635:x1874407346741248:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574343.538451:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574343.538480:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574343.538486:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504592300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346741376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574343.538493:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574343.538497:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb7c6c lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c65 expref: 24 pid: 6503 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.538506:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb7c6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c65 expref: 24 pid: 6503 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.538515:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574343.538543:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504592300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346741376:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574343.538549:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574343.538585:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346741248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574343.538607:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346741376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574343.543217:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574343.543326:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb7c18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7c11 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.543346:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb7c18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c11 expref: 23 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574343.543363:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874407346741504:0@lo:104: 00000100:00100000:2.0:1787574343.543434:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574343.543488:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be75000/0xd18a1efeeddb7c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7c03 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.543497:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be75000/0xd18a1efeeddb7c0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c03 expref: 23 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574343.543506:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874407346741632:0@lo:104: 00000100:00100000:2.0:1787574343.543551:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574343.543573:0:10386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346300 going to sleep for 11 seconds 00010000:00010000:2.0:1787574343.543601:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd83000/0xd18a1efeeddb7d92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7d8b expref: 23 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574343.543617:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874407346740992:0@lo:104: 00010000:00010000:2.0:1787574343.543629:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb7c6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7c65 expref: 22 pid: 6503 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574343.543639:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874407346741120:0@lo:104: 00000100:00100000:0.0:1787574343.543798:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346741504 00000100:00100000:0.0:1787574343.543816:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346741504 00000100:00100000:0.0:1787574343.543850:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346741632 00000100:00100000:0.0:1787574343.543852:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346741632 00000100:00100000:0.0:1787574343.543864:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574343.543872:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:10386:x1874407346741504:12345-0@lo:104: 00010000:00010000:0.0:1787574343.543885:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.543946:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574343.543951:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:10386:x1874407346741504:12345-0@lo:104: Request processed in 80us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574343.543959:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574343.543973:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574343.543979:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:10386:x1874407346741632:12345-0@lo:104: 00010000:00010000:0.0:1787574343.543986:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb7c03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544011:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787574343.544016:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:10386:x1874407346741632:12345-0@lo:104: Request processed in 38us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574343.544021:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1787574343.544076:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574343.544081:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544090:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574343.544094:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544104:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574343.544111:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574343.544117:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574343.544154:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544161:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574343.544178:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544185:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb600/0xd18a1efeeddb7c11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544194:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574343.544197:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb7c03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544202:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574343.544205:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb7c03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544217:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb7c03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574343.544224:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb7c03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574343.544230:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574343.544265:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb7c03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544271:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574343.544284:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb7c03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544292:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb7c03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7c0a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544304:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574343.544306:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574343.544307:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574343.544324:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346741760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574343.544351:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574343.544378:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346741888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574343.544399:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574343.544425:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346741760 00000100:00100000:0.0:1787574343.544428:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346741760 00010000:00010000:0.0:1787574343.544443:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb7c18 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c11 expref: 22 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574343.544492:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346741888 00000100:00100000:0.0:1787574343.544494:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346741888 00010000:00010000:0.0:1787574343.544506:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be75000/0xd18a1efeeddb7c0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c03 expref: 23 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574343.544520:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787574343.544525:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:3637:x1874407346741760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574343.544536:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574343.544541:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb7c18 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c11 expref: 23 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544549:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb7c18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c11 expref: 23 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544565:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574343.544589:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:3637:x1874407346741760:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574343.544595:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787574343.544606:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574343.544612:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3634:x1874407346741888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574343.544620:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574343.544624:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be75000/0xd18a1efeeddb7c0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c03 expref: 22 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544632:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be75000/0xd18a1efeeddb7c0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7c03 expref: 22 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574343.544642:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574343.544674:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3634:x1874407346741888:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574343.544680:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574343.544729:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346741760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574343.544749:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346741888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574343.545387:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1787574343.545531:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574343.553743:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323606016 00000100:00100000:3.0:1787574343.553757:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323606016 00010000:00010000:3.0:1787574343.553813:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be74e00/0xd18a1efeeddb7eaa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b539 expref: 10 pid: 6504 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574343.553896:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:3.0:1787574343.553907:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2405:x1874407323606016:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574343.553921:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574343.553927:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be74e00/0xd18a1efeeddb7eaa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b539 expref: 10 pid: 6504 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574343.553941:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be74e00/0xd18a1efeeddb7eaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b539 expref: 10 pid: 6504 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574343.553962:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574343.553972:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574343.553990:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574343.553998:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574343.554005:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574343.554029:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574343.554036:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574343.554041:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574343.554049:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574343.554058:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574343.554068:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574343.554339:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74e00/0xd18a1efeeddb7eaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b539 expref: 10 pid: 6504 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574343.554352:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874407346740864:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574343.554367:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb7c18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7c11 expref: 21 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574343.554375:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874407346741504:0@lo:104: 00010000:00010000:2.0:1787574343.554385:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75000/0xd18a1efeeddb7c0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7c03 expref: 20 pid: 6504 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574343.554393:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874407346741632:0@lo:104: 00010000:00010000:2.0:1787574343.554424:0:10386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.554433:0:10386:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.554440:0:10386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574343.554447:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82a00/0xd18a1efeeddb7f6e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574343.556939:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:2405:x1874407323606016:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 3021us (11543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574343.556954:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1787574343.945813:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574343.945868:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574343.945904:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574343.945937:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574343.945977:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574343.946127:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323606144 00000100:00100000:2.0:1787574343.946139:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323606144 00000100:00100000:2.0:1787574343.946201:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:2.0:1787574343.946212:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:2405:x1874407323606144:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574343.946233:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323606400 00000100:00100000:1.0:1787574343.946265:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323606400 00000100:00100000:1.0:1787574343.946311:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323606272 00000100:00100000:1.0:1787574343.946314:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323606272 00000100:00100000:2.0:1787574343.946321:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:2405:x1874407323606144:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 110us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.946331:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:1.0:1787574343.946346:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323606400:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574343.946351:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:1.0:1787574343.946383:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323606400:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.946389:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:2.0:1787574343.946398:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:3.0:1787574343.946463:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323606656 00000100:00100000:3.0:1787574343.946467:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323606656 00000100:00100000:3.0:1787574343.946663:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323606528 00000100:00100000:3.0:1787574343.946668:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323606528 00000100:00100000:3.0:1787574343.946696:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:1.0:1787574343.946704:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:3.0:1787574343.946706:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323606656:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574343.946717:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323606528:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574343.946741:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323606656:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 37us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574343.946754:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:1.0:1787574343.946755:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323606528:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 39us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574343.946765:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00080000:1.0:1787574343.946788:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574343.946792:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574343.946795:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574343.946797:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787574343.946846:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323606272:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574343.946877:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323606272:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 227us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574343.946884:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 92 00010000:00010000:0.0:1787574344.370353:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787574344.625371:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574344.625380:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53bf11000 from 4 10000000:01000000:0.0:1787574344.625385:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574344.625434:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574344.625460:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574344.625473:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574344.625511:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.625583:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574344.625634:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346742016 00000100:00100000:0.0:1787574344.625642:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574344.625643:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346742016 00000100:00100000:1.0:1787574344.625707:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787574344.625717:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346742016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574344.625730:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574344.625746:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb7f7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7f75 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574344.625769:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb7f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f75 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574344.625781:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb7f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f75 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574344.625803:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74800, rc 0) 00000100:00100000:1.0:1787574344.625850:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346742016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574344.625859:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787574344.625889:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574344.625913:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574344.625923:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574344.625981:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.626009:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574344.626029:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574344.626049:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346742144 00000100:00100000:1.0:1787574344.626054:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346742144 00000100:00100000:1.0:1787574344.626080:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787574344.626087:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346742144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574344.626212:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346742144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574344.626221:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787574344.626428:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.626476:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.626628:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574344.626655:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574344.626667:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346742272 00000100:00100000:1.0:1787574344.626672:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346742272 00000100:00100000:1.0:1787574344.626703:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787574344.626710:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346742272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574344.626804:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346742272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574344.626812:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787574344.626830:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574344.627094:0:10437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10437:1874407346742400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574344.627197:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574344.627216:0:10437:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53522f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574344.627235:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346742400 00000100:00100000:0.0:1787574344.627420:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346742400 00000100:00100000:1.0:1787574344.627501:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787574344.627509:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:10437:x1874407346742400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574344.627590:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:10437:x1874407346742400:12345-0@lo:502:llog_process_th.0 Request processed in 82us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574344.627605:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787574344.627626:0:10437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10437:1874407346742400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574344.627660:0:10437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574344.627672:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574344.627674:0:10437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787574344.627680:0:10437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca53bf11000 00000020:00000080:3.0:1787574344.627684:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787574344.627769:0:10437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10437:1874407346742528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574344.627810:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574344.627840:0:10437:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51e9a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574344.627846:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346742528 00000100:00100000:1.0:1787574344.627852:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346742528 00000100:00100000:1.0:1787574344.627879:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787574344.627887:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:10437:x1874407346742528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574344.627967:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:10437:x1874407346742528:12345-0@lo:502:llog_process_th.0 Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574344.627974:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787574344.628148:0:10437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10437:1874407346742528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574344.628169:0:10437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574344.628174:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574344.628175:0:10437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787574344.628179:0:10437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787574344.630365:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787574344.630406:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574344.630418:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574344.630429:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574344.630437:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574344.630439:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53bc3a000 from 4 10000000:01000000:0.0:1787574344.630442:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574344.630580:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574344.630589:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574344.630600:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574344.630625:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.630680:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574344.630729:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574344.630730:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346742656 00000100:00100000:3.0:1787574344.630737:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346742656 00000100:00100000:3.0:1787574344.630783:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787574344.630793:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346742656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574344.630804:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574344.630817:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be98800/0xd18a1efeeddb7f8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7f83 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574344.630841:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be98800/0xd18a1efeeddb7f8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f83 expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574344.630852:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be98800/0xd18a1efeeddb7f8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f83 expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574344.630861:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be98800, rc 0) 00000100:00100000:3.0:1787574344.630905:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346742656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574344.630919:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787574344.630930:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574344.630943:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574344.630952:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574344.631003:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.631026:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574344.631053:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574344.631061:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346742784 00000100:00100000:3.0:1787574344.631066:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346742784 00000100:00100000:3.0:1787574344.631094:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787574344.631101:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346742784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574344.631211:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346742784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574344.631218:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787574344.631227:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.631276:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.631315:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574344.631342:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574344.631355:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346742912 00000100:00100000:3.0:1787574344.631360:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346742912 00000100:00100000:3.0:1787574344.631395:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787574344.631402:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346742912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574344.631508:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346742912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574344.631516:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787574344.631577:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346742912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.631817:0:10439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10439:1874407346743040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574344.631851:0:10439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574344.631870:0:10439:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574344.631883:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346743040 00000100:00100000:3.0:1787574344.631887:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346743040 00000100:00100000:3.0:1787574344.631918:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787574344.631926:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:10439:x1874407346743040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574344.632007:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:10439:x1874407346743040:12345-0@lo:502:llog_process_th.0 Request processed in 82us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574344.632014:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787574344.632014:0:10439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10439:1874407346743040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787574344.632038:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574344.632048:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574344.632050:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787574344.632060:0:10439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca53bc3a000 00000020:00000080:0.0:1787574344.632063:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787574344.632132:0:10439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10439:1874407346743168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574344.632164:0:10439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574344.632180:0:10439:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574344.632722:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346743168 00000100:00100000:3.0:1787574344.632728:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346743168 00000100:00100000:3.0:1787574344.632764:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787574344.632770:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:10439:x1874407346743168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574344.632859:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:10439:x1874407346743168:12345-0@lo:502:llog_process_th.0 Request processed in 88us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574344.632865:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787574344.632962:0:10439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10439:1874407346743168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574344.632993:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574344.632999:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574344.633002:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787574344.633007:0:10439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787574344.633094:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787574344.633128:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574344.633137:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574344.633147:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574344.633159:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787574344.633161:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca526758000 from 4 10000000:01000000:3.0:1787574344.633164:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574344.633189:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574344.633197:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574344.633206:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574344.633223:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346743296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574344.633346:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574344.633370:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346743296 00000100:00100000:3.0:1787574344.633373:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574344.633374:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346743296 00000100:00100000:0.0:1787574344.633397:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787574344.633404:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346743296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574344.633414:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574344.633428:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7f98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7f91 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574344.633460:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7f98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f91 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574344.633470:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7f98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f91 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574344.633480:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10200, rc 0) 00000100:00100000:0.0:1787574344.633564:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346743296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574344.633577:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787574344.633587:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346743296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574344.633599:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574344.633615:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574344.633672:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346743424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574344.633700:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574344.633721:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574344.633734:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346743424 00000100:00100000:0.0:1787574344.633738:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346743424 00000100:00100000:0.0:1787574344.633763:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787574344.633769:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346743424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.633875:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346743424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574344.633881:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787574344.633883:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346743424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574344.633911:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346743552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574344.633952:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574344.633969:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574344.633974:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346743552 00000100:00100000:0.0:1787574344.633977:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346743552 00000100:00100000:0.0:1787574344.634004:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787574344.634012:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346743552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.634093:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346743552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574344.634100:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346743552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574344.634101:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787574344.634419:0:10440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10440:1874407346743680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574344.634466:0:10440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574344.634503:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346743680 00000100:00100000:3.0:1787574344.634508:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346743680 00000100:00100000:3.0:1787574344.634536:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787574344.634543:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:10440:x1874407346743680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574344.634607:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:10440:x1874407346743680:12345-0@lo:502:llog_process_th.0 Request processed in 64us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574344.634613:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787574344.634684:0:10440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574344.634698:0:10440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10440:1874407346743680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787574344.634718:0:10440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574344.634726:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574344.634728:0:10440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787574344.634736:0:10440:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca526758000 00000020:00000080:0.0:1787574344.634739:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787574344.634842:0:10440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10440:1874407346743808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574344.634880:0:10440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574344.634900:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346743808 00000100:00100000:0.0:1787574344.634903:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346743808 00000100:00100000:0.0:1787574344.634923:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787574344.634929:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:10440:x1874407346743808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574344.634990:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:10440:x1874407346743808:12345-0@lo:502:llog_process_th.0 Request processed in 60us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574344.634995:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787574344.635020:0:10440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574344.635031:0:10440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10440:1874407346743808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787574344.635047:0:10440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574344.635051:0:10440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574344.635053:0:10440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787574344.635056:0:10440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787574344.635221:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787574344.635273:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574344.635282:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574344.635294:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574344.635309:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787574344.635312:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca5109bd800 from 4 10000000:01000000:3.0:1787574344.635314:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574344.635332:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574344.635340:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574344.635349:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574344.635360:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346743936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574344.635386:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574344.635403:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574344.635423:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346743936 00000100:00100000:2.0:1787574344.635428:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346743936 00000100:00100000:2.0:1787574344.635475:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787574344.635483:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346743936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574344.635492:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574344.635502:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7fa6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7f9f expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574344.635522:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f9f expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574344.635612:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f9f expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574344.635623:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83600, rc 0) 00000100:00100000:2.0:1787574344.635663:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346743936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574344.635671:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787574344.635683:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346743936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574344.635696:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574344.635703:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574344.635744:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346744064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574344.635770:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574344.635801:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574344.635805:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346744064 00000100:00100000:2.0:1787574344.635810:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346744064 00000100:00100000:2.0:1787574344.635839:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787574344.635847:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346744064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574344.636004:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346744064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574344.636012:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787574344.636080:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346744064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574344.636268:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346744192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574344.637025:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574344.637063:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346744192 00000100:00100000:1.0:1787574344.637066:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574344.637068:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346744192 00000100:00100000:2.0:1787574344.637265:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787574344.637275:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346744192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574344.637368:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346744192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574344.637375:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787574344.637391:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346744192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574344.637900:0:10442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10442:1874407346744320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574344.637946:0:10442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574344.638001:0:10442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574344.638074:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346744320 00000100:00100000:3.0:1787574344.638078:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346744320 00000100:00100000:1.0:1787574344.638346:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787574344.638353:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:10442:x1874407346744320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574344.638502:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:10442:x1874407346744320:12345-0@lo:502:llog_process_th.0 Request processed in 148us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574344.638509:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787574344.638660:0:10442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10442:1874407346744320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574344.638682:0:10442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574344.638690:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574344.638691:0:10442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787574344.638696:0:10442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca5109bd800 00000020:00000080:2.0:1787574344.638698:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787574344.638789:0:10442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10442:1874407346744448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574344.638817:0:10442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574344.638840:0:10442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346240 going to sleep for 11 seconds 00000100:00100000:1.0:1787574344.638851:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346744448 00000100:00100000:1.0:1787574344.638855:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346744448 00000100:00100000:1.0:1787574344.638887:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787574344.638894:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:10442:x1874407346744448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574344.638975:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:10442:x1874407346744448:12345-0@lo:502:llog_process_th.0 Request processed in 80us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574344.638982:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787574344.639009:0:10442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:10442:1874407346744448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574344.639029:0:10442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574344.639034:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574344.639035:0:10442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787574344.639039:0:10442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787574344.639106:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787574344.639137:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574344.639152:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574344.639163:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574345.394050:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574345.571556:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574345.571609:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323606784 00000100:00100000:3.0:1787574345.571619:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323606784 00000100:00100000:3.0:1787574345.571679:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 275 00000100:00100000:3.0:1787574345.571690:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:6179:x1874407323606784:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574345.571706:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574345.571723:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7fad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b57f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574345.571765:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b57f expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574345.571776:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b57f expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574345.571786:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99800, rc 0) 00000100:00100000:3.0:1787574345.571840:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6179:x1874407323606784:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 152us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574345.571847:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 275 00000100:00100000:3.0:1787574345.576624:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574345.576662:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323606912 00000100:00100000:3.0:1787574345.576672:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323606912 00000100:00100000:3.0:1787574345.576720:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 276 00000100:00100000:3.0:1787574345.576730:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6179:x1874407323606912:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574345.576922:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6179:x1874407323606912:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 192us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574345.576938:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 276 00000100:00100000:0.0:1787574345.586687:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574345.586726:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323607040 00000100:00100000:0.0:1787574345.586736:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323607040 00000100:00100000:0.0:1787574345.586783:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 277 00000100:00100000:0.0:1787574345.586793:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6179:x1874407323607040:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574345.586949:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6179:x1874407323607040:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 157us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574345.586958:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 277 00000100:00100000:0.0:1787574345.597270:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574345.599914:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323607168 00000100:00100000:3.0:1787574345.599930:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323607168 00000100:00100000:3.0:1787574345.599992:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 278 00000100:00100000:3.0:1787574345.600004:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6745:x1874407323607168:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574345.600162:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6745:x1874407323607168:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 160us (2902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574345.609351:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 278 00000100:00100000:1.0:1787574345.610088:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574345.610152:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323607296 00000100:00100000:0.0:1787574345.610163:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323607296 00000100:00100000:0.0:1787574345.610216:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 279 00000100:00100000:0.0:1787574345.610225:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6745:x1874407323607296:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574345.610410:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:6745:x1874407323607296:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 184us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574345.610418:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 279 00010000:00010000:0.0:1787574346.417856:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574346.481553:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346744576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574346.481627:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574346.481759:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346744576 00000100:00100000:1.0:1787574346.481768:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346744576 00000100:00100000:1.0:1787574346.481833:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787574346.481844:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346744576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574346.481872:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574346.481930:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346744576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574346.481936:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787574346.481975:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40349f800 x1874407346744576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574346.481992:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346744576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787574346.482294:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574346.486111:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346744704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574346.486184:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574346.486473:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346744704 00000100:00100000:3.0:1787574346.486482:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346744704 00000100:00100000:3.0:1787574346.486562:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574346.486572:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346744704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574346.486594:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574346.486644:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346744704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574346.486650:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787574346.486688:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402692680 x1874407346744704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574346.486707:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346744704:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787574346.486768:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787574347.441361:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574348.023565:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346744832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574348.023643:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574348.023781:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346744832 00000100:00100000:3.0:1787574348.023789:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346744832 00000100:00100000:3.0:1787574348.023837:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787574348.023857:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346744832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574348.023894:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787574348.023941:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346744832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574348.023948:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787574348.023997:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346744832:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574348.468827:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574348.529373:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346744960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574348.529452:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574348.529862:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346745088:0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.529898:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574348.529921:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346745600:0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.529946:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574348.529962:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346746112:0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.529993:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574348.530008:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787574348.530014:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346745472:0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.530034:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574348.530047:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346745984:0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.530065:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574348.530078:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346746496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574348.530094:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574348.530117:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346745600 00000100:00100000:1.0:1787574348.530124:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346745600 00000100:00100000:1.0:1787574348.530167:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346746112 00000100:00100000:1.0:1787574348.530170:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346746112 00000100:00100000:1.0:1787574348.530192:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787574348.530201:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346745600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.530267:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346745600:12345-0@lo:400:kworker.0 Request processed in 66us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574348.530274:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787574348.530293:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787574348.530299:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346746112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.530327:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346746112:12345-0@lo:400:kworker.0 Request processed in 28us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574348.530332:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787574348.530374:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346745600:0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.530383:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346746112:0@lo:400:kworker.0 00000100:00100000:0.0:1787574348.530695:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346744960 00000100:00100000:0.0:1787574348.530700:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346744960 00000100:00100000:0.0:1787574348.530831:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787574348.530844:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346744960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574348.530867:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574348.530919:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346744960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574348.530925:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787574348.530944:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574348.530948:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574348.530985:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346745216:0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531015:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574348.531047:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346745728:0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531068:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574348.531082:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346746240:0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531099:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574348.531111:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787574348.531117:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346745344:0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531136:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574348.531145:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346745856:0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531163:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574348.531176:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346746368:0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531194:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574348.531223:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346745088 00000100:00100000:3.0:1787574348.531227:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346745088 00000100:00100000:3.0:1787574348.531385:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787574348.531393:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346745088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531438:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346745088:12345-0@lo:400:kworker.0 Request processed in 45us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574348.531451:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787574348.531480:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346745216 00000100:00100000:3.0:1787574348.531484:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346745216 00000100:00100000:3.0:1787574348.531499:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346745728 00000100:00100000:3.0:1787574348.531502:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346745728 00000100:00100000:3.0:1787574348.531518:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346746240 00000100:00100000:3.0:1787574348.531520:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346746240 00000100:00100000:3.0:1787574348.531531:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346745344 00000100:00100000:3.0:1787574348.531534:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346745344 00000100:00100000:3.0:1787574348.531545:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787574348.531551:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346745216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531584:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346745216:12345-0@lo:400:kworker.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574348.531591:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787574348.531601:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787574348.531607:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346745728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531629:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346745728:12345-0@lo:400:kworker.0 Request processed in 23us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574348.531636:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787574348.531645:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787574348.531650:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346746240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531673:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346746240:12345-0@lo:400:kworker.0 Request processed in 22us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574348.531679:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787574348.531689:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787574348.531695:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346745344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531731:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346745344:12345-0@lo:400:kworker.0 Request processed in 36us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574348.531737:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787574348.531756:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346745472 00000100:00100000:3.0:1787574348.531760:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346745472 00000100:00100000:3.0:1787574348.531775:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346746496 00000100:00100000:3.0:1787574348.531777:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346746496 00000100:00100000:3.0:1787574348.531786:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787574348.531792:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346745472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.531824:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346745472:12345-0@lo:400:kworker.0 Request processed in 32us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574348.531926:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346745984 00000100:00100000:1.0:1787574348.531937:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346745984 00000100:00100000:1.0:1787574348.531964:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346745856 00000100:00100000:1.0:1787574348.531967:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346745856 00000100:00100000:1.0:1787574348.531978:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346746368 00000100:00100000:1.0:1787574348.531981:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346746368 00000100:00100000:1.0:1787574348.531993:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787574348.531998:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346745984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.532030:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346745984:12345-0@lo:400:kworker.0 Request processed in 32us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574348.532036:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787574348.532048:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787574348.532053:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346745856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.532076:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346745856:12345-0@lo:400:kworker.0 Request processed in 22us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574348.532082:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787574348.532092:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787574348.532097:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346746368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.532120:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346746368:12345-0@lo:400:kworker.0 Request processed in 23us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574348.532124:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787574348.532150:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346746624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574348.532172:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574348.532204:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346745472:0@lo:400:kworker.0 00010000:00080000:1.0:1787574348.532217:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40349dc00 x1874407346745984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574348.532227:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346745984:0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.532271:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346745088:0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.532298:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346746624 00000100:00100000:1.0:1787574348.532302:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346746624 00000100:00100000:1.0:1787574348.532321:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787574348.532327:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346746624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574348.532339:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574348.532371:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346746624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574348.532376:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787574348.532398:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402692680 x1874407346746624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574348.532423:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346746624:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787574348.532821:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574348.532826:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574348.532829:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787574348.532928:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40345ca80 x1874407346744960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574348.532943:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346744960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574348.533126:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787574348.533144:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787574348.533151:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346746496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574348.533176:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574348.533224:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346746496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (3128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574348.533230:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787574348.533293:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346745344:0@lo:400:kworker.0 00010000:00080000:3.0:1787574348.533306:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40349d880 x1874407346745856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574348.533315:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346745856:0@lo:400:kworker.0 00010000:00080000:3.0:1787574348.533324:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40349d180 x1874407346746368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574348.533331:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346746368:0@lo:400:kworker.0 00000100:00100000:3.0:1787574348.533352:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346745216:0@lo:400:kworker.0 00010000:00080000:3.0:1787574348.533363:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40349df80 x1874407346745728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574348.533370:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346745728:0@lo:400:kworker.0 00010000:00080000:3.0:1787574348.533381:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40349d500 x1874407346746240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574348.533389:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346746240:0@lo:400:kworker.0 00000100:00100000:1.0:1787574348.533563:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346746496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574349.070270:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574349.070320:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574349.070345:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574349.070384:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323607680 00000100:00100000:0.0:1787574349.070393:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323607680 00000100:00100000:0.0:1787574349.070461:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323607552 00000100:00100000:0.0:1787574349.070465:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323607552 00000100:00100000:0.0:1787574349.070489:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:0.0:1787574349.070500:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323607680:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574349.070572:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323607680:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574349.070580:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:0.0:1787574349.070596:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:0.0:1787574349.070603:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323607552:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574349.070628:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323607552:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574349.070634:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00080000:0.0:1787574349.070652:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574349.070656:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574349.071078:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323607424 00000100:00100000:1.0:1787574349.071084:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323607424 00000100:00100000:1.0:1787574349.071121:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 281 00000100:00100000:1.0:1787574349.071127:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2402:x1874407323607424:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574349.071155:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2402:x1874407323607424:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574349.071162:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 281 00000100:00100000:0.0:1787574349.084405:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574349.084465:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574349.084525:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323607808 00000100:00100000:1.0:1787574349.084536:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323607808 00000100:00100000:1.0:1787574349.084606:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323607936 00000100:00100000:1.0:1787574349.084610:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323607936 00000100:00100000:1.0:1787574349.084634:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1787574349.084659:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2401:x1874407323607808:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:1.0:1787574349.084695:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7ebf 00000100:00080000:1.0:1787574349.084705:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9ca403182800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787574349.084748:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787574349.084919:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+2:2401:x1874407323607808:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 263us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574349.084927:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1787574349.084944:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1787574349.084952:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2401:x1874407323607936:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:1.0:1787574349.084965:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7ec6 00000100:00080000:1.0:1787574349.084972:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9ca4033b9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787574349.084993:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787574349.085068:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+2:2401:x1874407323607936:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 116us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574349.085075:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00010000:00010000:1.0:1787574349.085151:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574349.085157:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574349.085528:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574349.085532:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787574349.491371:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574350.516839:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787574351.217468:0:10687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787574351.539489:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574351.602510:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574351.602534:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346746752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574351.602654:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574351.602780:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346746752 00000100:00100000:2.0:1787574351.602800:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346746752 00000100:00100000:2.0:1787574351.602865:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787574351.602876:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346746752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574351.602906:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574351.602952:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346746752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574351.602960:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787574351.603091:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574351.603123:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40349ce00 x1874407346746752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574351.603142:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346746752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574351.603749:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574351.603761:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346746880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574351.603798:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574351.604113:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346746880 00000100:00100000:1.0:1787574351.604119:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346746880 00000100:00100000:1.0:1787574351.604168:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787574351.604176:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346746880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787574351.604189:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574351.604226:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346746880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574351.604232:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787574351.604343:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40349f800 x1874407346746880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574351.604357:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346746880:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787574351.605191:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787574352.561642:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574353.137757:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574353.137791:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346747008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574353.137865:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574353.137970:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346747008 00000100:00100000:3.0:1787574353.137979:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346747008 00000100:00100000:3.0:1787574353.138039:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787574353.138049:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346747008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574353.138096:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787574353.138152:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346747008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574353.138159:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787574353.138989:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346747008:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787574353.585553:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574353.650326:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574353.650532:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346747264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574353.650600:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574353.650679:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346747264 00000100:00100000:1.0:1787574353.650687:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346747264 00000100:00100000:1.0:1787574353.650740:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787574353.650750:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346747264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574353.650778:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574353.650822:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346747264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574353.650828:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787574353.650850:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787574353.650881:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40349c700 x1874407346747264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574353.650898:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346747264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574353.651168:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346747392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574353.651289:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574353.651426:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346747648:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.651456:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574353.651475:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346748160:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.651496:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574353.651519:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346748672:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.651540:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574353.651564:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787574353.651570:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346747520:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.651598:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574353.651619:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346748032:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.651663:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574353.651684:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346748544:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.651705:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574353.651731:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346747648 00000100:00100000:0.0:1787574353.651736:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346747648 00000100:00100000:0.0:1787574353.651764:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346748032 00000100:00100000:0.0:1787574353.651767:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346748032 00000100:00100000:0.0:1787574353.651786:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346748544 00000100:00100000:0.0:1787574353.651789:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346748544 00000100:00100000:0.0:1787574353.651803:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787574353.651810:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346747648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.651849:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346747648:12345-0@lo:400:kworker.0 Request processed in 40us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.651867:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787574353.651882:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787574353.651888:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346748032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.651918:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346748032:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.651923:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787574353.651935:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787574353.651941:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346748544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.651965:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346748544:12345-0@lo:400:kworker.0 Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.651971:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787574353.651988:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346748160 00000100:00100000:0.0:1787574353.651991:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346748160 00000100:00100000:0.0:1787574353.652015:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346748672 00000100:00100000:0.0:1787574353.652018:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346748672 00000100:00100000:0.0:1787574353.652041:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787574353.652048:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346748160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652077:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346748160:12345-0@lo:400:kworker.0 Request processed in 30us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.652084:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787574353.652095:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787574353.652101:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346748672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652128:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346748672:12345-0@lo:400:kworker.0 Request processed in 27us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.652134:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787574353.652162:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346747520 00000100:00100000:0.0:1787574353.652166:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346747520 00000100:00100000:0.0:1787574353.652191:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787574353.652197:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346747520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652227:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346747520:12345-0@lo:400:kworker.0 Request processed in 31us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.652233:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:0.0:1787574353.652281:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574353.652285:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574353.652288:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574353.652306:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346747904:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652332:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574353.652350:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346748416:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652385:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574353.652400:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787574353.652406:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346747776:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574353.652435:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346748288:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652455:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574353.652485:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346748288 00000100:00100000:0.0:1787574353.652489:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346748288 00000100:00100000:0.0:1787574353.652516:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787574353.652521:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346748288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652552:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346748288:12345-0@lo:400:kworker.0 Request processed in 30us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.652557:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787574353.652571:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574353.652585:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346747904 00000100:00100000:0.0:1787574353.652588:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346747904 00000100:00100000:0.0:1787574353.652620:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346748416 00000100:00100000:0.0:1787574353.652626:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346748416 00000100:00100000:0.0:1787574353.652638:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346747776 00000100:00100000:0.0:1787574353.652641:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346747776 00000100:00100000:0.0:1787574353.652660:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787574353.652666:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346747904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652698:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346747904:12345-0@lo:400:kworker.0 Request processed in 32us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.652704:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787574353.652714:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787574353.652719:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346748416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652743:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346748416:12345-0@lo:400:kworker.0 Request processed in 23us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.652748:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787574353.652758:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787574353.652764:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346747776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652785:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346747776:12345-0@lo:400:kworker.0 Request processed in 23us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574353.652790:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1787574353.652802:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574353.652825:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346747776:0@lo:400:kworker.0 00010000:00080000:0.0:1787574353.652835:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca50459aa00 x1874407346748288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574353.652844:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346748288:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652863:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346747904:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652871:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346748416:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652897:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346747520:0@lo:400:kworker.0 00010000:00080000:0.0:1787574353.652907:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504599880 x1874407346748032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574353.652915:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346748032:0@lo:400:kworker.0 00010000:00080000:0.0:1787574353.652924:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403486680 x1874407346748544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574353.652931:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346748544:0@lo:400:kworker.0 00000100:00100000:0.0:1787574353.652940:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346747648:0@lo:400:kworker.0 00010000:00080000:0.0:1787574353.652947:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504598380 x1874407346748160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574353.652955:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346748160:0@lo:400:kworker.0 00010000:00080000:0.0:1787574353.652963:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403487480 x1874407346748672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574353.652970:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346748672:0@lo:400:kworker.0 00000100:00100000:2.0:1787574353.653483:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346747392 00000100:00100000:2.0:1787574353.653489:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346747392 00000100:00100000:2.0:1787574353.653528:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787574353.653538:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346747392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574353.653565:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574353.653602:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787574353.653614:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787574353.653665:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346747392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574353.653673:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787574353.653712:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346747392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574353.654996:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346747136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574353.655060:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574353.655234:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346747136 00000100:00100000:3.0:1787574353.655272:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346747136 00000100:00100000:3.0:1787574353.655316:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787574353.655325:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346747136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574353.655344:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574353.656925:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346747136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1592us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574353.656938:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787574353.657326:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40345ca80 x1874407346747136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574353.657350:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346747136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574354.200055:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574354.200089:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574354.200118:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574354.200145:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323608320 00000100:00100000:2.0:1787574354.200155:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323608320 00000100:00100000:2.0:1787574354.200219:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323608192 00000100:00100000:2.0:1787574354.200222:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323608192 00000100:00100000:2.0:1787574354.200259:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:2.0:1787574354.200269:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323608320:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574354.200748:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323608320:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 479us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574354.200758:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:2.0:1787574354.200778:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:2.0:1787574354.200785:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323608192:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574354.200834:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323608192:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 50us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574354.200840:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00080000:2.0:1787574354.200863:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574354.200866:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574354.201909:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323608064 00000100:00100000:3.0:1787574354.201919:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323608064 00000100:00100000:3.0:1787574354.201978:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 283 00000100:00100000:3.0:1787574354.201988:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2403:x1874407323608064:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574354.205688:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2403:x1874407323608064:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 3689us (5629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574354.205703:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 283 00010000:00010000:3.0:1787574354.610406:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787574354.676817:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000020:00000080:0.0:1787574354.676826:0:8419:0:(genops.c:885:class_export_put()) final put ffff9ca403186000/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000020:00000080:1.0:1787574354.677537:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403186000/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 for lustre-OST0000 00000020:00000080:1.0:1787574354.677582:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca403182800 for lustre-OST0000 00000001:00100000:3.0:1787574354.680513:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000020:00000080:3.0:1787574354.680523:0:9505:0:(genops.c:885:class_export_put()) final put ffff9ca4033bf800/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000020:00000080:2.0:1787574354.680879:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033bf800/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 for lustre-OST0001 00000020:00000080:2.0:1787574354.680935:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4033b9800 for lustre-OST0001 00010000:00010000:2.0:1787574355.637387:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574356.660304:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574356.721640:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346748800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574356.721715:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574356.723069:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346748800 00000100:00100000:1.0:1787574356.723081:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346748800 00000100:00100000:1.0:1787574356.723159:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787574356.723170:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346748800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574356.723209:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574356.723367:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346748800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574356.723375:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1787574356.723503:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec3800 x1874407346748800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574356.723523:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346748800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574356.723543:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574356.723551:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346748928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574356.723592:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574356.727218:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346748928 00000100:00100000:0.0:1787574356.727260:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346748928 00000100:00100000:0.0:1787574356.727354:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787574356.727365:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346748928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574356.727409:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574356.727501:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346748928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (3908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574356.727508:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787574356.727556:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec2680 x1874407346748928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574356.727578:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346748928:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787574356.734708:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787574357.686373:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574358.131496:0:10930:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing yml_node 00000100:00100000:1.0:1787574358.266538:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346749056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574358.266608:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574358.276101:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346749056 00000100:00100000:3.0:1787574358.276117:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346749056 00000100:00100000:3.0:1787574358.276176:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787574358.276188:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346749056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574358.276227:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787574358.288618:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346749056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12418us (21995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574358.288636:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787574358.290305:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346749056:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574358.714450:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574358.770843:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574358.770864:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346749184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574358.770933:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574358.772375:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346749184 00000100:00100000:2.0:1787574358.772388:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346749184 00000100:00100000:2.0:1787574358.772453:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787574358.772464:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346749184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574358.772494:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574358.772565:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346749184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574358.772573:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787574358.772594:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787574358.772629:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40351f480 x1874407346749184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574358.772650:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346749184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574358.772794:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346749312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574358.772831:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574358.772873:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346749312 00000100:00100000:3.0:1787574358.772877:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346749312 00000100:00100000:3.0:1787574358.772910:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787574358.772918:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346749312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574358.772930:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574358.772963:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346749312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574358.772969:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787574358.773124:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787574358.773144:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40351ca80 x1874407346749312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574358.773158:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346749312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574358.775708:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346749696:0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.775775:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574358.775809:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346750208:0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.775831:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574358.775847:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346750720:0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.775868:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574358.775889:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787574358.775895:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346749568:0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.775920:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574358.775944:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346750080:0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.775964:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574358.775979:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346750592:0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.776084:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574358.776111:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346749696 00000100:00100000:3.0:1787574358.776119:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346749696 00000100:00100000:3.0:1787574358.776159:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346750208 00000100:00100000:3.0:1787574358.776162:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346750208 00000100:00100000:3.0:1787574358.776185:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346750720 00000100:00100000:3.0:1787574358.776199:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346750720 00000100:00100000:3.0:1787574358.776216:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346750080 00000100:00100000:3.0:1787574358.776219:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346750080 00000100:00100000:3.0:1787574358.776230:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346750592 00000100:00100000:3.0:1787574358.776569:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346750592 00000100:00100000:3.0:1787574358.776597:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787574358.776606:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346749696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.776671:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346749696:12345-0@lo:400:kworker.0 Request processed in 65us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574358.776692:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787574358.776710:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787574358.776717:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346750208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.776750:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346750208:12345-0@lo:400:kworker.0 Request processed in 34us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574358.776756:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787574358.776766:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787574358.776772:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346750720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.776814:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346750720:12345-0@lo:400:kworker.0 Request processed in 43us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574358.776820:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787574358.776832:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787574358.776838:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346750080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.776862:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346750080:12345-0@lo:400:kworker.0 Request processed in 25us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574358.776868:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787574358.776879:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787574358.776885:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346750592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.776910:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346750592:12345-0@lo:400:kworker.0 Request processed in 26us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574358.776915:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787574358.776943:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346749568 00000100:00100000:3.0:1787574358.776948:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346749568 00000100:00100000:0.0:1787574358.777218:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346750080:0@lo:400:kworker.0 00000100:00100000:0.0:1787574358.777230:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346750592:0@lo:400:kworker.0 00000100:00100000:0.0:1787574358.777273:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346749696:0@lo:400:kworker.0 00010000:00080000:0.0:1787574358.777286:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403596a00 x1874407346750208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574358.777296:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346750208:0@lo:400:kworker.0 00010000:00080000:0.0:1787574358.777306:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d46d80 x1874407346750720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574358.777314:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346750720:0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.777563:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787574358.777573:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346749568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.777639:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346749568:12345-0@lo:400:kworker.0 Request processed in 68us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574358.777647:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787574358.777688:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346749440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574358.777720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574358.777783:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346749952:0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.777801:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574358.778360:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346749568:0@lo:400:kworker.0 00000100:00100000:2.0:1787574358.784310:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346749824:0@lo:400:kworker.0 00000100:00100000:2.0:1787574358.784399:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574358.784437:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346750336:0@lo:400:kworker.0 00000100:00100000:2.0:1787574358.784460:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574358.784511:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346750336 00000100:00100000:2.0:1787574358.784518:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346750336 00000100:00100000:2.0:1787574358.784572:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574358.784583:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346750336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574358.784638:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346750336:12345-0@lo:400:kworker.0 Request processed in 57us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574358.784645:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787574358.784695:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403594380 x1874407346750336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574358.784709:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346750336:0@lo:400:kworker.0 00000100:00100000:2.0:1787574358.784733:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346749824 00000100:00100000:2.0:1787574358.784736:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346749824 00000100:00100000:2.0:1787574358.784762:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787574358.784767:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346749824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574358.784798:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346749824:12345-0@lo:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574358.784804:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787574358.784827:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346749824:0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.786683:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346750464:0@lo:400:kworker.0 00000100:00100000:3.0:1787574358.786733:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787574358.786769:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574358.786775:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574358.786778:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574358.787469:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346749440 00000100:00100000:1.0:1787574358.787480:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346749440 00000100:00100000:1.0:1787574358.787527:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346749952 00000100:00100000:1.0:1787574358.787530:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346749952 00000100:00100000:1.0:1787574358.787547:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574358.787557:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346749440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574358.787594:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574358.787654:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346749440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (9932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574358.787661:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574358.787680:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787574358.787686:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346749952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574358.787717:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346749952:12345-0@lo:400:kworker.0 Request processed in 32us (9915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574358.787723:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787574358.787770:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346749440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574358.787782:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346749952:0@lo:400:kworker.0 00000100:00100000:1.0:1787574358.788424:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346750464 00000100:00100000:1.0:1787574358.788430:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346750464 00000100:00100000:1.0:1787574358.788471:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787574358.788477:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346750464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574358.788523:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346750464:12345-0@lo:400:kworker.0 Request processed in 47us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574358.788530:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787574358.788578:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5350e6680 x1874407346750464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574358.788589:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346750464:0@lo:400:kworker.0 00000100:00080000:3.0:1787574358.790103:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574359.309040:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574359.309076:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574359.309100:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574359.309194:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323608704 00000100:00100000:3.0:1787574359.309205:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323608704 00000100:00100000:3.0:1787574359.309292:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323608576 00000100:00100000:3.0:1787574359.309296:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323608576 00000100:00100000:3.0:1787574359.309332:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:3.0:1787574359.309344:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323608704:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574359.309421:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323608704:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574359.309430:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:3.0:1787574359.309448:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:3.0:1787574359.309455:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323608576:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574359.309479:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323608576:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574359.309498:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:1.0:1787574359.309868:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323608448 00000100:00100000:1.0:1787574359.309873:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323608448 00000100:00100000:1.0:1787574359.309913:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 285 00000100:00100000:1.0:1787574359.309921:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2402:x1874407323608448:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574359.309956:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2402:x1874407323608448:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 37us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574359.309963:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 285 00000100:00080000:2.0:1787574359.311525:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574359.311535:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787574359.729508:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574360.758560:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574361.777876:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574361.841921:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346750848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574361.841994:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574361.842439:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574361.842460:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346750976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574361.842488:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574361.842522:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346750848 00000100:00100000:3.0:1787574361.842531:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346750848 00000100:00100000:2.0:1787574361.842546:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346750976 00000100:00100000:2.0:1787574361.842550:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346750976 00000100:00100000:2.0:1787574361.842581:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787574361.842590:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346750976:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787574361.842616:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787574361.842618:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574361.842695:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346750976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574361.842703:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787574361.842720:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787574361.842727:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346750848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574361.842738:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574361.842764:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346750848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574361.842770:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787574361.843686:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40349ce00 x1874407346750976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574361.843720:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346750976:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787574361.843735:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec0700 x1874407346750848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574361.843746:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346750848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787574362.801499:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574363.378469:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574363.378494:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346751104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574363.378566:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574363.378695:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346751104 00000100:00100000:1.0:1787574363.378703:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346751104 00000100:00100000:1.0:1787574363.378754:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787574363.378764:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346751104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787574363.378800:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787574363.378866:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346751104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574363.378873:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787574363.379023:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346751104:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574363.826821:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574363.890117:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346751232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574363.890211:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574363.890471:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346751232 00000100:00100000:0.0:1787574363.890482:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346751232 00000100:00100000:0.0:1787574363.890563:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787574363.890587:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346751232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574363.890623:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787574363.890687:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346751232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574363.890694:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787574363.890740:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346751232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574363.891001:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346751360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574363.891034:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574363.891070:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346751360 00000100:00100000:3.0:1787574363.891075:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346751360 00000100:00100000:3.0:1787574363.891106:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787574363.891113:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346751360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574363.891132:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574363.891166:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346751360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574363.891172:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787574363.891218:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53be5df80 x1874407346751360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574363.891264:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346751360:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787574363.892006:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574363.892172:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346751616:0@lo:400:kworker.0 00000100:00100000:2.0:1787574363.892230:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574363.892293:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346752128:0@lo:400:kworker.0 00000100:00100000:2.0:1787574363.892320:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574363.892335:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346752640:0@lo:400:kworker.0 00000100:00100000:2.0:1787574363.892355:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574363.892374:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787574363.892379:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346751744:0@lo:400:kworker.0 00000100:00100000:2.0:1787574363.892400:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574363.892426:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346752256:0@lo:400:kworker.0 00000100:00100000:2.0:1787574363.892448:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574363.892462:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346752768:0@lo:400:kworker.0 00000100:00100000:2.0:1787574363.892481:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574363.892662:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346751616 00000100:00100000:0.0:1787574363.892669:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346751616 00000100:00100000:0.0:1787574363.892716:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787574363.892725:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346751616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574363.892774:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346751616:12345-0@lo:400:kworker.0 Request processed in 50us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574363.892780:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787574363.892835:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346751616:0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893076:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346752128 00000100:00100000:3.0:1787574363.893081:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346752128 00000100:00100000:3.0:1787574363.893117:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346752640 00000100:00100000:3.0:1787574363.893121:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346752640 00000100:00100000:3.0:1787574363.893134:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346751744 00000100:00100000:3.0:1787574363.893136:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346751744 00000100:00100000:3.0:1787574363.893146:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346752256 00000100:00100000:3.0:1787574363.893148:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346752256 00000100:00100000:3.0:1787574363.893160:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346752768 00000100:00100000:3.0:1787574363.893162:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346752768 00000100:00100000:3.0:1787574363.893175:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787574363.893181:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346752128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893234:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346752128:12345-0@lo:400:kworker.0 Request processed in 52us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574363.893265:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787574363.893290:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787574363.893299:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346752640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893326:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346752640:12345-0@lo:400:kworker.0 Request processed in 30us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574363.893332:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787574363.893343:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787574363.893349:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346751744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893375:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346751744:12345-0@lo:400:kworker.0 Request processed in 26us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574363.893380:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787574363.893401:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787574363.893407:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346752256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893435:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346752256:12345-0@lo:400:kworker.0 Request processed in 29us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574363.893441:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787574363.893451:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787574363.893457:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346752768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893483:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346752768:12345-0@lo:400:kworker.0 Request processed in 26us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574363.893489:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787574363.893518:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346751488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574363.893543:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574363.893560:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346752000:0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893575:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574363.893589:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346752512:0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574363.893630:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787574363.893636:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346751872:0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574363.893692:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346752384:0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893711:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574363.893725:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346752896:0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574363.893766:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346752512 00000100:00100000:3.0:1787574363.893771:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346752512 00000100:00100000:3.0:1787574363.893806:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346752384 00000100:00100000:3.0:1787574363.893809:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346752384 00000100:00100000:3.0:1787574363.893820:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346752896 00000100:00100000:3.0:1787574363.893822:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346752896 00000100:00100000:3.0:1787574363.893835:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787574363.893840:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346752512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893875:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346752512:12345-0@lo:400:kworker.0 Request processed in 35us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574363.893881:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787574363.893892:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787574363.893898:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346752384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893923:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346752384:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574363.893928:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787574363.893939:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787574363.893945:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346752896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.893970:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346752896:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574363.893976:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787574363.893994:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346751872 00000100:00100000:3.0:1787574363.893997:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346751872 00000100:00100000:3.0:1787574363.894017:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787574363.894023:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346751872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.894057:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346751872:12345-0@lo:400:kworker.0 Request processed in 35us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574363.894062:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787574363.894095:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346751872:0@lo:400:kworker.0 00010000:00080000:3.0:1787574363.894116:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec1180 x1874407346752384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574363.894125:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346752384:0@lo:400:kworker.0 00010000:00080000:3.0:1787574363.894133:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec2680 x1874407346752896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574363.894142:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346752896:0@lo:400:kworker.0 00010000:00080000:3.0:1787574363.894151:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec0e00 x1874407346752512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574363.894158:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346752512:0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.894179:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346752000 00000100:00100000:3.0:1787574363.894182:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346752000 00000100:00100000:3.0:1787574363.894204:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787574363.894209:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346752000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574363.894263:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346752000:12345-0@lo:400:kworker.0 Request processed in 53us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574363.894269:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787574363.894305:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346752000:0@lo:400:kworker.0 00000100:00100000:2.0:1787574363.895018:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346751488 00000100:00100000:2.0:1787574363.895024:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346751488 00000100:00100000:2.0:1787574363.895069:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787574363.895077:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346751488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574363.895092:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574363.895138:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346751488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574363.895144:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787574363.895176:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40345c700 x1874407346751488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574363.895204:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346751488:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787574363.895378:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574363.895383:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574363.895386:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574363.895389:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574363.895416:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346751744:0@lo:400:kworker.0 00010000:00080000:0.0:1787574363.895427:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec1500 x1874407346752256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574363.895437:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346752256:0@lo:400:kworker.0 00010000:00080000:0.0:1787574363.895449:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec0380 x1874407346752768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574363.895473:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346752768:0@lo:400:kworker.0 00000100:00100000:0.0:1787574363.895487:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346752128:0@lo:400:kworker.0 00000100:00100000:0.0:1787574363.895498:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346752640:0@lo:400:kworker.0 00000100:00100000:2.0:1787574364.432229:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574364.432310:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574364.432365:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574364.432398:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323608832 00000100:00100000:2.0:1787574364.432409:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323608832 00000100:00100000:2.0:1787574364.432467:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 287 00000100:00100000:2.0:1787574364.432477:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2403:x1874407323608832:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574364.432552:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2403:x1874407323608832:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 76us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574364.432560:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 287 00000100:00100000:2.0:1787574364.432602:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323609088 00000100:00100000:2.0:1787574364.432606:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323609088 00000100:00100000:2.0:1787574364.432642:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323608960 00000100:00100000:2.0:1787574364.432645:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323608960 00000100:00100000:2.0:1787574364.432669:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:2.0:1787574364.432676:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323609088:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574364.432721:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323609088:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 45us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574364.432729:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:2.0:1787574364.432744:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:2.0:1787574364.432750:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323608960:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574364.432775:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323608960:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574364.432781:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00080000:2.0:1787574364.433541:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574364.433548:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:1.0:1787574364.444798:0:11115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00010000:00010000:1.0:1787574364.852646:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574365.878061:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574366.898597:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574366.961472:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574366.961501:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346753024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574366.961573:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574366.961961:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346753024 00000100:00100000:0.0:1787574366.961970:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346753024 00000100:00100000:0.0:1787574366.962025:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787574366.962037:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346753024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574366.962077:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574366.962126:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346753024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574366.962134:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787574366.962279:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346753152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574366.962313:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574366.962513:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346753152 00000100:00100000:3.0:1787574366.962518:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346753152 00000100:00100000:3.0:1787574366.962550:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787574366.962556:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346753152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574366.962576:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574366.962610:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346753152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574366.962617:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1787574366.962648:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec0700 x1874407346753152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787574366.962649:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574366.962667:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346753152:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787574366.962674:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402726680 x1874407346753024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574366.962687:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346753024:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787574367.191829:0:11213:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00010000:00010000:2.0:1787574367.921472:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574368.497490:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574368.497516:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346753280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574368.497590:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574368.498340:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346753280 00000100:00100000:0.0:1787574368.498349:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346753280 00000100:00100000:0.0:1787574368.498403:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787574368.498411:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346753280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574368.498445:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574368.498493:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346753280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574368.498501:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787574368.498685:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346753280:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574368.948220:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574369.009628:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574369.009651:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346753536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574369.009715:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574369.009770:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346753536 00000100:00100000:0.0:1787574369.009779:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346753536 00000100:00100000:1.0:1787574369.009785:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346753408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574369.009802:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787574369.009838:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574369.009844:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346753408 00000100:00100000:0.0:1787574369.009849:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346753408 00000100:00100000:1.0:1787574369.009860:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787574369.009869:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346753536:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574369.009880:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787574369.009890:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346753408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574369.009897:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1787574369.009904:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574369.009952:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346753536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574369.009958:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346753408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574369.009962:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787574369.010002:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574369.010038:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574369.010051:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346753664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574369.010085:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574369.010123:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346753664 00000100:00100000:2.0:1787574369.010127:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346753664 00000100:00100000:2.0:1787574369.010154:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787574369.010161:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346753664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574369.010186:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787574369.010255:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346753664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574369.010262:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787574369.010299:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346753664:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1787574369.010381:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025ff800 x1874407346753536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574369.010399:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346753536:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787574369.010414:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402727b80 x1874407346753408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574369.010425:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346753408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574369.010514:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574369.010525:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346753792:0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.010560:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574369.010592:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346754176:0@lo:400:kworker.0 00000100:00100000:3.0:1787574369.010606:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346753792 00000100:00100000:3.0:1787574369.010612:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346753792 00000100:00100000:1.0:1787574369.010618:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574369.010635:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346754688:0@lo:400:kworker.0 00000100:00100000:3.0:1787574369.010647:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787574369.010658:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346753792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.010664:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574369.010684:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787574369.010690:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346754304:0@lo:400:kworker.0 00000100:00100000:3.0:1787574369.010709:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346753792:12345-0@lo:400:kworker.0 Request processed in 52us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574369.010717:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574369.010720:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787574369.010769:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346754688 00000100:00100000:3.0:1787574369.010773:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346754688 00000100:00100000:1.0:1787574369.010799:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346754816:0@lo:400:kworker.0 00000100:00100000:3.0:1787574369.010811:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787574369.010820:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346754688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.010828:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574369.010853:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346753792:0@lo:400:kworker.0 00000100:00100000:3.0:1787574369.010872:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346754688:12345-0@lo:400:kworker.0 Request processed in 52us (207us total) trans 0 rc 0/0 00010000:00080000:1.0:1787574369.010876:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402506300 x1874407346754688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574369.010884:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787574369.010893:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346754688:0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.010915:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346754176 00000100:00100000:3.0:1787574369.010928:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346754304 00000100:00100000:3.0:1787574369.010933:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346754304 00000100:00100000:3.0:1787574369.010959:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346754816 00000100:00100000:3.0:1787574369.010962:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346754816 00000100:00100000:3.0:1787574369.010977:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787574369.010991:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346754304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.011024:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346754176 00000100:00100000:3.0:1787574369.011030:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346754304:12345-0@lo:400:kworker.0 Request processed in 38us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574369.011037:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787574369.011054:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787574369.011062:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346754816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.011096:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346754816:12345-0@lo:400:kworker.0 Request processed in 34us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574369.013830:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787574369.013847:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787574369.013861:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346754176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.013948:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346754304:0@lo:400:kworker.0 00000100:00100000:3.0:1787574369.013954:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346754176:12345-0@lo:400:kworker.0 Request processed in 106us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574369.013964:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787574369.013970:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346754816:0@lo:400:kworker.0 00000100:00080000:3.0:1787574369.013996:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574369.013998:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346754176:0@lo:400:kworker.0 00000100:00080000:3.0:1787574369.014004:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574369.014040:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346754048:0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.014082:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574369.014090:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346753920:0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.014113:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346754560:0@lo:400:kworker.0 00000100:00100000:3.0:1787574369.014126:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574369.014148:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574369.014154:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346754432:0@lo:400:kworker.0 00000100:00100000:3.0:1787574369.014184:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574369.014193:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346754048 00000100:00100000:1.0:1787574369.014200:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346754048 00000100:00100000:3.0:1787574369.014207:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346754944:0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.014269:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787574369.014277:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346754048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.014318:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346754048:12345-0@lo:400:kworker.0 Request processed in 41us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574369.014325:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787574369.014347:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346754560 00000100:00100000:1.0:1787574369.014352:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346754560 00000100:00100000:0.0:1787574369.014367:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787574369.014395:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787574369.014403:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346754560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574369.014421:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346754048:0@lo:400:kworker.0 00010000:00080000:0.0:1787574369.014445:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505c00 x1874407346754560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574369.014447:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346754560:12345-0@lo:400:kworker.0 Request processed in 43us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574369.014457:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346754560:0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.014470:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787574369.014474:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346753920 00000100:00100000:0.0:1787574369.014478:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346753920 00000100:00080000:1.0:1787574369.014497:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574369.014507:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346754432 00000100:00100000:0.0:1787574369.014511:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346754432 00000100:00100000:1.0:1787574369.014525:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787574369.014536:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346753920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574369.014542:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787574369.014552:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346754432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.014579:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346753920:12345-0@lo:400:kworker.0 Request processed in 44us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574369.014588:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787574369.014596:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346754432:12345-0@lo:400:kworker.0 Request processed in 45us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574369.014604:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1787574369.014606:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574369.015564:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574369.015819:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346754944 00000100:00100000:1.0:1787574369.015826:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346754944 00000100:00100000:3.0:1787574369.015866:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346753920:0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.015872:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787574369.015878:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346754944:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787574369.015885:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402504a80 x1874407346754432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574369.015896:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346754432:0@lo:400:kworker.0 00000100:00100000:1.0:1787574369.015923:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346754944:12345-0@lo:400:kworker.0 Request processed in 43us (361us total) trans 0 rc 0/0 00010000:00080000:3.0:1787574369.015930:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505180 x1874407346754944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574369.015946:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787574369.015951:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346754944:0@lo:400:kworker.0 00000100:00080000:2.0:1787574369.016063:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574369.547609:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574369.547652:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574369.547681:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574369.547760:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323609216 00000100:00100000:0.0:1787574369.547769:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323609216 00000100:00100000:0.0:1787574369.547824:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 289 00000100:00100000:0.0:1787574369.547833:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2405:x1874407323609216:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574369.547920:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2405:x1874407323609216:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574369.547927:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 289 00000100:00100000:3.0:1787574369.547959:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323609344 00000100:00100000:3.0:1787574369.547966:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323609344 00000100:00100000:3.0:1787574369.548019:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323609472 00000100:00100000:3.0:1787574369.548023:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323609472 00000100:00100000:3.0:1787574369.548044:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:3.0:1787574369.548051:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323609344:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574369.548091:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323609344:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 40us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574369.548098:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:3.0:1787574369.548117:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:3.0:1787574369.548125:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323609472:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:0.0:1787574369.548483:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574369.548488:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574369.548660:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323609472:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 526us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574369.548669:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 132 00010000:00010000:1.0:1787574369.969370:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574370.335627:0:11310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:1.0:1787574370.993490:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574372.017495:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574372.081524:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574372.081548:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346755072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574372.081615:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574372.081757:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346755072 00000100:00100000:2.0:1787574372.081765:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346755072 00000100:00100000:2.0:1787574372.081830:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787574372.081842:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346755072:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787574372.081880:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787574372.081881:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574372.081927:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346755200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574372.081956:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574372.082033:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346755200 00000100:00100000:1.0:1787574372.082037:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346755200 00000100:00100000:1.0:1787574372.082078:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787574372.082084:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346755200:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574372.082085:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346755072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 247us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574372.082092:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00002000:00000024:1.0:1787574372.082094:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574372.082172:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346755200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574372.082179:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1787574372.082213:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec0380 x1874407346755200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574372.082231:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346755200:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787574372.082304:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574372.082683:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505180 x1874407346755072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574372.082696:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346755072:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787574373.043482:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574373.090782:0:11359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 08:26:10 EDT 2026 00000100:00100000:2.0:1787574373.617647:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574373.617670:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346755328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574373.617746:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574373.617956:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346755328 00000100:00100000:0.0:1787574373.617963:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346755328 00000100:00100000:0.0:1787574373.618018:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787574373.618027:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346755328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574373.618062:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574373.618118:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346755328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574373.618124:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787574373.618285:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346755328:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787574374.065524:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574374.129854:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574374.129879:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346755456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574374.129956:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574374.130027:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346755456 00000100:00100000:2.0:1787574374.130036:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346755456 00000100:00100000:2.0:1787574374.130097:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787574374.130107:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346755456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574374.130142:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787574374.130216:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346755456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574374.130223:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787574374.130287:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346755456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574374.130559:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346755712:0@lo:400:kworker.0 00000100:00100000:2.0:1787574374.130590:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574374.130609:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346756224:0@lo:400:kworker.0 00000100:00100000:2.0:1787574374.130643:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574374.130670:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346756736:0@lo:400:kworker.0 00000100:00100000:2.0:1787574374.130692:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574374.130714:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787574374.130719:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346755840:0@lo:400:kworker.0 00000100:00100000:2.0:1787574374.130741:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574374.130757:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346756352:0@lo:400:kworker.0 00000100:00100000:2.0:1787574374.130777:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574374.130794:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346756864:0@lo:400:kworker.0 00000100:00100000:2.0:1787574374.133432:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574374.133533:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346755712 00000100:00100000:2.0:1787574374.133543:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346755712 00000100:00100000:2.0:1787574374.133585:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346756224 00000100:00100000:2.0:1787574374.133588:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346756224 00000100:00100000:2.0:1787574374.133610:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346756736 00000100:00100000:2.0:1787574374.133613:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346756736 00000100:00100000:2.0:1787574374.133664:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787574374.133674:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346755712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574374.133732:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346755712:12345-0@lo:400:kworker.0 Request processed in 60us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574374.133738:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787574374.133754:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787574374.133761:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346756224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574374.133787:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346756224:12345-0@lo:400:kworker.0 Request processed in 28us (3144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574374.133792:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787574374.133815:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787574374.133821:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346756736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574374.133846:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346756736:12345-0@lo:400:kworker.0 Request processed in 26us (3154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574374.133853:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787574374.133881:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346755840 00000100:00100000:2.0:1787574374.133884:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346755840 00000100:00100000:2.0:1787574374.133905:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787574374.133911:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346755840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574374.133942:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346755840:12345-0@lo:400:kworker.0 Request processed in 31us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574374.133948:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787574374.133991:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346755840:0@lo:400:kworker.0 00000100:00100000:2.0:1787574374.134005:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346755712:0@lo:400:kworker.0 00010000:00080000:2.0:1787574374.134017:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025fd500 x1874407346756224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574374.134034:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346756224:0@lo:400:kworker.0 00010000:00080000:2.0:1787574374.134045:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025ff100 x1874407346756736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574374.134052:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346756736:0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.134420:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346755968:0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.134458:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574374.134494:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346756480:0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.134519:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574374.134540:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346756992:0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.134561:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574374.134583:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787574374.134589:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346755584:0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.134616:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574374.134638:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346756096:0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.134659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574374.134676:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346756608:0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.134695:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574374.134727:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346756352 00000100:00100000:3.0:1787574374.134732:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346756352 00000100:00100000:3.0:1787574374.134757:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346756864 00000100:00100000:3.0:1787574374.134760:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346756864 00000100:00100000:3.0:1787574374.134770:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346756480 00000100:00100000:3.0:1787574374.134772:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346756480 00000100:00100000:3.0:1787574374.134784:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346756992 00000100:00100000:3.0:1787574374.134786:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346756992 00000100:00100000:3.0:1787574374.134811:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787574374.134819:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346756352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.134860:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346756352:12345-0@lo:400:kworker.0 Request processed in 43us (4081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574374.134866:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787574374.134880:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787574374.134886:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346756864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.134911:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346756864:12345-0@lo:400:kworker.0 Request processed in 26us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574374.134924:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787574374.134935:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787574374.134941:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346756480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.134971:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346756480:12345-0@lo:400:kworker.0 Request processed in 29us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574374.134976:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787574374.134987:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787574374.134992:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346756992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.135015:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346756992:12345-0@lo:400:kworker.0 Request processed in 23us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574374.135020:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787574374.135039:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346755968 00000100:00100000:3.0:1787574374.135042:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346755968 00000100:00100000:3.0:1787574374.135056:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346756096 00000100:00100000:3.0:1787574374.135058:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346756096 00000100:00100000:3.0:1787574374.135069:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346756608 00000100:00100000:3.0:1787574374.135071:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346756608 00000100:00100000:3.0:1787574374.135083:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787574374.135088:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346755968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.135131:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346755968:12345-0@lo:400:kworker.0 Request processed in 42us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574374.135137:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787574374.135148:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787574374.135154:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346756096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.135179:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346756096:12345-0@lo:400:kworker.0 Request processed in 26us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574374.135204:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787574374.135216:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787574374.135222:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346756608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.135285:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346756608:12345-0@lo:400:kworker.0 Request processed in 63us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574374.135291:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1787574374.135307:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574374.135311:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574374.135314:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574374.135316:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574374.135334:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346755584 00000100:00100000:3.0:1787574374.135338:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346755584 00000100:00100000:3.0:1787574374.135363:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787574374.135368:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346755584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.135394:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346755584:12345-0@lo:400:kworker.0 Request processed in 26us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574374.135399:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787574374.135445:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346755584:0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.135456:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346756096:0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.135463:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346756608:0@lo:400:kworker.0 00000100:00100000:3.0:1787574374.135470:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346755968:0@lo:400:kworker.0 00010000:00080000:3.0:1787574374.135480:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025fce00 x1874407346756480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574374.135488:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346756480:0@lo:400:kworker.0 00010000:00080000:3.0:1787574374.135507:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025fca80 x1874407346756992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574374.135515:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346756992:0@lo:400:kworker.0 00010000:00080000:3.0:1787574374.135548:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025fd180 x1874407346756352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574374.135556:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346756352:0@lo:400:kworker.0 00010000:00080000:3.0:1787574374.135565:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025fed80 x1874407346756864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574374.135573:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346756864:0@lo:400:kworker.0 00000100:00100000:0.0:1787574374.142627:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574374.142669:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346757120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574374.142737:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574374.142790:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346757120 00000100:00100000:0.0:1787574374.142814:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346757120 00000100:00100000:0.0:1787574374.142876:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787574374.142887:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346757120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574374.142918:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574374.142961:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346757120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574374.142985:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1787574374.143028:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec1f80 x1874407346757120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574374.143046:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346757120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574374.145234:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574374.145272:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346757248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574374.145352:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574374.145405:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346757248 00000100:00100000:3.0:1787574374.145414:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346757248 00000100:00100000:3.0:1787574374.145474:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787574374.145484:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346757248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574374.145512:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574374.145554:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346757248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574374.145562:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1787574374.145598:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505180 x1874407346757248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574374.145614:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346757248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574374.674786:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574374.674832:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574374.674873:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574374.674955:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323609600 00000100:00100000:2.0:1787574374.674967:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323609600 00000100:00100000:2.0:1787574374.675030:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 291 00000100:00100000:2.0:1787574374.675041:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2405:x1874407323609600:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574374.675110:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2405:x1874407323609600:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 71us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574374.675118:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 291 00000100:00100000:0.0:1787574374.675441:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323609728 00000100:00100000:0.0:1787574374.675446:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323609728 00000100:00100000:0.0:1787574374.675488:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323609856 00000100:00100000:0.0:1787574374.675491:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323609856 00000100:00100000:0.0:1787574374.675516:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:0.0:1787574374.675522:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323609728:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574374.675562:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323609728:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 40us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574374.675569:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:0.0:1787574374.675583:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:0.0:1787574374.675589:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323609856:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574374.675610:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323609856:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574374.675616:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00080000:2.0:1787574374.675740:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574374.675745:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787574375.090342:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574376.113465:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574377.144295:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574377.201569:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346757376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574377.201646:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574377.201674:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346757376 00000100:00100000:2.0:1787574377.201683:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346757376 00000100:00100000:2.0:1787574377.201742:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787574377.201753:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346757376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574377.201781:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574377.201829:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346757376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574377.201837:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787574377.201856:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574377.201864:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346757504:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787574377.201885:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505180 x1874407346757376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574377.201890:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574377.201916:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346757376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574377.201963:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346757504 00000100:00100000:3.0:1787574377.201968:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346757504 00000100:00100000:3.0:1787574377.202010:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787574377.202018:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346757504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574377.202028:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574377.202063:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346757504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574377.202069:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1787574377.202108:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505500 x1874407346757504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787574377.202110:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574377.202121:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346757504:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574378.162210:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574378.737578:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346757632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574378.737668:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574378.737978:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346757632 00000100:00100000:0.0:1787574378.737988:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346757632 00000100:00100000:0.0:1787574378.738060:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787574378.738070:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346757632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574378.738104:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574378.738173:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346757632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574378.738179:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787574378.738315:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346757632:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787574379.186851:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574379.250077:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346757760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574379.250194:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574379.251025:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574379.251041:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346757888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574379.251090:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574379.251204:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346757888 00000100:00100000:2.0:1787574379.251212:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346757888 00000100:00100000:2.0:1787574379.251298:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787574379.251309:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346757888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574379.251356:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787574379.251436:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346757888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574379.251445:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787574379.252232:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346758144:0@lo:400:kworker.0 00000100:00100000:3.0:1787574379.252308:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574379.252334:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346758656:0@lo:400:kworker.0 00000100:00100000:3.0:1787574379.252355:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574379.252374:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346759168:0@lo:400:kworker.0 00000100:00100000:3.0:1787574379.252393:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574379.252413:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787574379.252419:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346758016:0@lo:400:kworker.0 00000100:00100000:3.0:1787574379.252446:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574379.252469:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346758528:0@lo:400:kworker.0 00000100:00100000:3.0:1787574379.252492:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574379.252507:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346759040:0@lo:400:kworker.0 00000100:00100000:3.0:1787574379.252526:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574379.252558:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346758016 00000100:00100000:3.0:1787574379.252565:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346758016 00000100:00100000:3.0:1787574379.252603:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787574379.252611:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346758016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574379.252670:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346758016:12345-0@lo:400:kworker.0 Request processed in 60us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574379.252678:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787574379.252707:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346758144 00000100:00100000:3.0:1787574379.252712:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346758144 00000100:00100000:3.0:1787574379.252730:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346758656 00000100:00100000:3.0:1787574379.252732:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346758656 00000100:00100000:3.0:1787574379.252750:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346759168 00000100:00100000:3.0:1787574379.252753:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346759168 00000100:00100000:3.0:1787574379.252763:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346758528 00000100:00100000:3.0:1787574379.252765:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346758528 00000100:00100000:3.0:1787574379.252775:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346759040 00000100:00100000:3.0:1787574379.252777:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346759040 00000100:00100000:3.0:1787574379.252788:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787574379.252794:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346758144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574379.252826:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346758144:12345-0@lo:400:kworker.0 Request processed in 32us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574379.252833:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787574379.252845:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787574379.252851:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346758656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.253004:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346758272:0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.253036:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574379.253055:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346758784:0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.253077:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574379.253094:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346759296:0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.253116:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574379.253168:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346757888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574379.253187:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787574379.253192:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346758400:0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.253215:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574379.253228:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346758912:0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.253267:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574379.253306:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346758784 00000100:00100000:1.0:1787574379.253310:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346758784 00000100:00100000:1.0:1787574379.253340:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346759296 00000100:00100000:1.0:1787574379.253343:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346759296 00000100:00100000:1.0:1787574379.253355:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346758912 00000100:00100000:1.0:1787574379.253358:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346758912 00000100:00100000:1.0:1787574379.253388:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787574379.253395:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346758784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.253432:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346758784:12345-0@lo:400:kworker.0 Request processed in 37us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574379.253438:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787574379.253454:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787574379.253460:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346759296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.253486:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346759296:12345-0@lo:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574379.253491:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787574379.253502:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787574379.253508:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346758912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.253533:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346758912:12345-0@lo:400:kworker.0 Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574379.253539:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787574379.253573:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5045a8700 x1874407346758912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574379.253585:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346758912:0@lo:400:kworker.0 00010000:00080000:1.0:1787574379.253595:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5045a8380 x1874407346758784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574379.253603:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346758784:0@lo:400:kworker.0 00010000:00080000:1.0:1787574379.253621:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f474700 x1874407346759296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574379.253629:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346759296:0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.253672:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346758016:0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.253683:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346758144:0@lo:400:kworker.0 00000100:00100000:0.0:1787574379.254360:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346757760 00000100:00100000:0.0:1787574379.254368:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346757760 00000100:00100000:0.0:1787574379.254412:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787574379.254423:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53c0d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346757760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574379.254449:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574379.254503:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53c0d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346757760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (4309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574379.254509:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787574379.254687:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346758400 00000100:00100000:0.0:1787574379.254692:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346758400 00000100:00100000:0.0:1787574379.254716:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787574379.254723:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346759168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574379.254759:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346759168:12345-0@lo:400:kworker.0 Request processed in 37us (2365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574379.254766:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787574379.254780:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787574379.254788:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346758528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574379.254816:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346758528:12345-0@lo:400:kworker.0 Request processed in 29us (2323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574379.254822:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787574379.254848:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787574379.254855:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346759040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574379.255852:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346759040:12345-0@lo:400:kworker.0 Request processed in 992us (3318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574379.256544:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346758528:0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.256560:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346759040:0@lo:400:kworker.0 00010000:00080000:1.0:1787574379.256576:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f474380 x1874407346759168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574379.256586:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346759168:0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.256642:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787574379.256650:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787574379.256666:0:8610:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787574379.256715:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787574379.256838:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346758656:12345-0@lo:400:kworker.0 Request processed in 3986us (4480us total) trans 0 rc 0/0 00000100:00080000:2.0:1787574379.256915:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574379.256920:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574379.256924:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574379.256926:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787574379.257015:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346759424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574379.257055:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574379.257100:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346758272 00000100:00100000:2.0:1787574379.257106:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346758272 00000100:00100000:2.0:1787574379.257155:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787574379.257164:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346758272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574379.257205:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346758272:12345-0@lo:400:kworker.0 Request processed in 41us (4166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574379.257210:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1787574379.257302:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402726680 x1874407346758656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574379.257312:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346758656:0@lo:400:kworker.0 00000100:00100000:2.0:1787574379.257339:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346759424 00000100:00100000:2.0:1787574379.257342:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346759424 00000100:00100000:2.0:1787574379.257367:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787574379.257373:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346759424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574379.257389:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574379.257424:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346759424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574379.257430:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1787574379.257451:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034ddf80 x1874407346759424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574379.257465:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346759424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574379.257488:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346758272:0@lo:400:kworker.0 00010000:00080000:2.0:1787574379.257497:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505500 x1874407346757760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574379.257505:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346757760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574379.257683:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787574379.257694:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346758400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574379.257736:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346758400:12345-0@lo:400:kworker.0 Request processed in 45us (4520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574379.257743:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787574379.257768:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346758400:0@lo:400:kworker.0 00000100:00100000:3.0:1787574379.264618:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787574379.793219:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574379.793301:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574379.793349:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574379.793352:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323609984 00000100:00100000:2.0:1787574379.793363:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323609984 00000100:00100000:2.0:1787574379.793436:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 293 00000100:00100000:2.0:1787574379.793454:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2405:x1874407323609984:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574379.793520:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2405:x1874407323609984:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574379.793538:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 293 00000100:00100000:0.0:1787574379.793568:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323610112 00000100:00100000:0.0:1787574379.793573:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323610112 00000100:00100000:0.0:1787574379.793613:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323610240 00000100:00100000:0.0:1787574379.793616:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323610240 00000100:00100000:0.0:1787574379.793637:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:0.0:1787574379.793643:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323610112:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:2.0:1787574379.793650:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574379.793654:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574379.793679:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:0.0:1787574379.793679:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323610112:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574379.793685:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:2.0:1787574379.793686:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323610240:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574379.793709:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323610240:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574379.793716:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 148 00010000:00010000:1.0:1787574380.215646:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574381.237523:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574382.258912:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574382.322368:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346759552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574382.322442:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574382.322830:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346759552 00000100:00100000:3.0:1787574382.322839:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346759552 00000100:00100000:3.0:1787574382.322907:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787574382.322919:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346759552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574382.322948:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574382.323000:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346759552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574382.323006:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1787574382.323060:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f474e00 x1874407346759552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574382.323077:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346759552:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787574382.323229:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574382.328456:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574382.335400:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346759680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574382.335484:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574382.342320:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346759680 00000100:00100000:2.0:1787574382.342335:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346759680 00000100:00100000:2.0:1787574382.342465:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787574382.342476:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346759680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574382.342505:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574382.342610:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346759680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (7125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574382.342617:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1787574382.342855:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f474e00 x1874407346759680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574382.342875:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346759680:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787574382.346881:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787574383.296341:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574383.858706:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574383.858731:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346759808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574383.858813:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574383.859062:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346759808 00000100:00100000:0.0:1787574383.859072:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346759808 00000100:00100000:0.0:1787574383.859140:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787574383.859168:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51ea43850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346759808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574383.859203:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574383.859291:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51ea43850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346759808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574383.859298:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787574383.863718:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346759808:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787574384.305608:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574384.369456:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574384.369480:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346759936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574384.369546:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574384.369610:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346759936 00000100:00100000:2.0:1787574384.369617:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346759936 00000100:00080000:0.0:1787574384.369672:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574384.369685:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787574384.369703:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346759936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574384.369867:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574384.370069:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346759936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 367us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574384.370077:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787574384.370215:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346760064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574384.370335:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574384.370453:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346760064 00000100:00100000:2.0:1787574384.370457:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346760064 00000100:00100000:2.0:1787574384.370485:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787574384.370491:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346760064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574384.370501:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574384.370526:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346760064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574384.370532:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787574384.370543:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787574384.370565:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034dd180 x1874407346760064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574384.370583:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346760064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574384.370597:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574384.370602:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346760192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574384.371193:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574384.372454:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346760704:0@lo:400:kworker.0 00000100:00100000:2.0:1787574384.372509:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574384.372534:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346761216:0@lo:400:kworker.0 00000100:00100000:2.0:1787574384.372557:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574384.372580:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787574384.372595:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346760576:0@lo:400:kworker.0 00000100:00100000:2.0:1787574384.372621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574384.372638:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346761088:0@lo:400:kworker.0 00000100:00100000:2.0:1787574384.372660:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574384.372690:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346760704 00000100:00100000:2.0:1787574384.372697:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346760704 00000100:00100000:2.0:1787574384.372760:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346761216 00000100:00100000:2.0:1787574384.372763:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346761216 00000100:00100000:2.0:1787574384.372781:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346760576 00000100:00100000:2.0:1787574384.372783:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346760576 00000100:00100000:2.0:1787574384.372796:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787574384.372803:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346760704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574384.372848:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346760704:12345-0@lo:400:kworker.0 Request processed in 44us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574384.372855:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787574384.372872:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787574384.372878:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346761216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574384.373130:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346760448:0@lo:400:kworker.0 00000100:00100000:3.0:1787574384.373162:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574384.373175:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346760960:0@lo:400:kworker.0 00000100:00100000:3.0:1787574384.373194:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574384.373214:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787574384.373220:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346760320:0@lo:400:kworker.0 00000100:00100000:3.0:1787574384.373281:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574384.373304:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346760832:0@lo:400:kworker.0 00000100:00100000:3.0:1787574384.373323:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574384.373334:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346761344:0@lo:400:kworker.0 00000100:00100000:3.0:1787574384.373351:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574384.373398:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346761088 00000100:00100000:3.0:1787574384.373403:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346761088 00000100:00100000:3.0:1787574384.373434:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346760960 00000100:00100000:3.0:1787574384.373437:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346760960 00000100:00100000:3.0:1787574384.373457:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574384.373464:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346761088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574384.373496:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346761088:12345-0@lo:400:kworker.0 Request processed in 32us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574384.373502:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574384.373515:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574384.373520:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346760960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574384.373549:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346760960:12345-0@lo:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574384.373554:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574384.373571:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346760448 00000100:00100000:3.0:1787574384.373574:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346760448 00000100:00100000:3.0:1787574384.373588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346760832 00000100:00100000:3.0:1787574384.373590:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346760832 00000100:00100000:3.0:1787574384.373600:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346761344 00000100:00100000:3.0:1787574384.373603:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346761344 00000100:00100000:3.0:1787574384.373615:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787574384.373620:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346760576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574384.373649:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346760576:12345-0@lo:400:kworker.0 Request processed in 29us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574384.373655:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787574384.373667:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787574384.373672:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346760448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574384.373695:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346760448:12345-0@lo:400:kworker.0 Request processed in 24us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574384.373791:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346761216:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574384.373800:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787574384.373816:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787574384.373822:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346760832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574384.373852:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346760832:12345-0@lo:400:kworker.0 Request processed in 31us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574384.373858:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787574384.373870:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787574384.373876:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346761344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574384.373922:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346761344:12345-0@lo:400:kworker.0 Request processed in 47us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574384.373929:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787574384.374038:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346760320 00000100:00100000:2.0:1787574384.374043:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346760320 00000100:00100000:2.0:1787574384.374072:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787574384.374078:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346760320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574384.374119:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346760320:12345-0@lo:400:kworker.0 Request processed in 42us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574384.374125:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787574384.374177:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346760576:0@lo:400:kworker.0 00010000:00080000:2.0:1787574384.374192:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366ce00 x1874407346761088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574384.374202:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346761088:0@lo:400:kworker.0 00000100:00100000:2.0:1787574384.374213:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346760704:0@lo:400:kworker.0 00000100:00100000:2.0:1787574384.374224:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346761216:0@lo:400:kworker.0 00000100:00080000:2.0:1787574384.374350:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574384.374356:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574384.374358:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574384.375158:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787574384.375207:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346760320:0@lo:400:kworker.0 00010000:00080000:3.0:1787574384.375223:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366d500 x1874407346760832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574384.375233:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346760832:0@lo:400:kworker.0 00010000:00080000:3.0:1787574384.375273:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366c000 x1874407346761344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574384.375281:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346761344:0@lo:400:kworker.0 00000100:00100000:3.0:1787574384.375293:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346760448:0@lo:400:kworker.0 00010000:00080000:3.0:1787574384.375303:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366d180 x1874407346760960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574384.375310:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346760960:0@lo:400:kworker.0 00000100:00100000:1.0:1787574384.375850:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346760192 00000100:00100000:1.0:1787574384.375858:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346760192 00000100:00100000:1.0:1787574384.376087:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787574384.376107:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346760192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574384.376142:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574384.376220:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346760192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (5028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574384.376226:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1787574384.376308:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366e680 x1874407346759936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574384.376323:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346759936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574384.376324:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346760192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574384.909391:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574384.909432:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574384.909458:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574384.909487:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323610624 00000100:00100000:3.0:1787574384.909497:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323610624 00000100:00100000:3.0:1787574384.909557:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323610496 00000100:00100000:3.0:1787574384.909560:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323610496 00000100:00100000:3.0:1787574384.909588:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 155 00000100:00100000:3.0:1787574384.909598:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323610624:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574384.909683:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323610624:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 86us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574384.909691:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 155 00000100:00100000:3.0:1787574384.909708:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00100000:3.0:1787574384.909715:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323610496:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574384.909741:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323610496:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574384.909747:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00080000:3.0:1787574384.909767:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574384.909771:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574384.910166:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323610368 00000100:00100000:1.0:1787574384.910173:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323610368 00000100:00100000:1.0:1787574384.910210:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 295 00000100:00100000:1.0:1787574384.910217:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2402:x1874407323610368:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574384.910277:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2402:x1874407323610368:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 60us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574384.910284:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 295 00010000:00010000:2.0:1787574385.330510:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574386.354785:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574387.385883:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574387.442468:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574387.442502:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346761472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574387.442598:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574387.442686:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346761472 00000100:00100000:0.0:1787574387.442696:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346761472 00000100:00100000:0.0:1787574387.442764:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787574387.442777:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346761472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574387.442813:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574387.442863:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346761472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574387.442871:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787574387.442895:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574387.442930:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec0380 x1874407346761472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574387.442954:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346761472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574387.458509:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346761600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574387.458607:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574387.458740:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346761600 00000100:00100000:0.0:1787574387.458769:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346761600 00000100:00100000:0.0:1787574387.458859:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787574387.458871:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346761600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574387.458903:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787574387.458981:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574387.469904:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346761600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11017us (11278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574387.469925:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1787574387.470414:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f477800 x1874407346761600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574387.470460:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346761600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574388.411409:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574388.979541:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346761728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574388.979625:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574388.979745:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346761728 00000100:00100000:1.0:1787574388.979754:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346761728 00000100:00100000:1.0:1787574388.979808:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787574388.979818:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346761728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787574388.979851:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787574388.979901:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346761728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574388.979908:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787574388.979993:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346761728:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787574389.426424:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574389.490358:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346761856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574389.490433:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574389.490505:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346761856 00000100:00100000:3.0:1787574389.490513:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346761856 00000100:00100000:3.0:1787574389.490558:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787574389.490566:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346761856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574389.490600:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574389.490648:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346761856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574389.490655:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787574389.490701:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346761856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574389.492425:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346761984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574389.492491:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574389.492605:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346761984 00000100:00100000:1.0:1787574389.492619:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346761984 00000100:00100000:1.0:1787574389.492689:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787574389.492700:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346761984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787574389.492726:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574389.492774:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346761984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574389.492781:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787574389.492835:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787574389.492863:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034dd500 x1874407346761984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574389.492880:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346761984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574389.497619:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346762112:0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.497699:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574389.497763:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346762112 00000100:00100000:0.0:1787574389.497770:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346762112 00000100:00100000:0.0:1787574389.497817:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787574389.497826:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346762112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.497876:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346762112:12345-0@lo:400:kworker.0 Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574389.497884:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787574389.497932:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346762112:0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.497962:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346762240:0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.497981:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574389.498018:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346762240 00000100:00100000:0.0:1787574389.498093:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346762240 00000100:00100000:0.0:1787574389.498147:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787574389.498155:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346762240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.498216:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346762240:12345-0@lo:400:kworker.0 Request processed in 62us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574389.498222:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787574389.498303:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346762368:0@lo:400:kworker.0 00000100:00100000:1.0:1787574389.498317:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346762240:0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.498328:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574389.498353:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346762368 00000100:00100000:0.0:1787574389.498357:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346762368 00000100:00100000:0.0:1787574389.498389:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787574389.498396:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346762368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.498443:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346762368:12345-0@lo:400:kworker.0 Request processed in 48us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574389.498449:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787574389.498482:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346762624:0@lo:400:kworker.0 00000100:00100000:1.0:1787574389.498507:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574389.498507:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574389.498516:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346762496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574389.498544:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574389.498548:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574389.498554:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346762752:0@lo:400:kworker.0 00000100:00100000:1.0:1787574389.498575:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346762368:0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.498578:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574389.498600:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346762496 00000100:00100000:0.0:1787574389.498604:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346762496 00000100:00100000:2.0:1787574389.498619:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346762624 00000100:00100000:2.0:1787574389.498622:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346762624 00000100:00100000:2.0:1787574389.498643:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346762752 00000100:00100000:2.0:1787574389.498646:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346762752 00000100:00100000:0.0:1787574389.498646:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787574389.498658:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346762496:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574389.498662:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787574389.498667:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346762624:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787574389.498672:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574389.498704:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346762624:12345-0@lo:400:kworker.0 Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574389.498704:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346762496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574389.498711:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787574389.498711:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787574389.498723:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787574389.498730:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346762752:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787574389.498742:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025fca80 x1874407346762496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574389.498758:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346762752:12345-0@lo:400:kworker.0 Request processed in 30us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574389.498758:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346762496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574389.498764:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00010000:00080000:0.0:1787574389.498784:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec1880 x1874407346762752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574389.498800:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346762752:0@lo:400:kworker.0 00000100:00080000:1.0:1787574389.498808:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574389.498813:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574389.498815:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574389.498824:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346762624:0@lo:400:kworker.0 00000100:00100000:1.0:1787574389.498873:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346762880:0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.498877:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346763136:0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.498897:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574389.498898:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574389.498914:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574389.498919:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346763008:0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.498921:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346763136 00000100:00100000:0.0:1787574389.498924:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346763136 00000100:00100000:1.0:1787574389.498941:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574389.498947:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787574389.498953:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346763136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574389.498964:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346762880 00000100:00100000:1.0:1787574389.498967:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346762880 00000100:00100000:0.0:1787574389.498984:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346763136:12345-0@lo:400:kworker.0 Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574389.498990:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787574389.498992:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346763008 00000100:00100000:1.0:1787574389.498995:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346763008 00000100:00100000:0.0:1787574389.499013:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346763136:0@lo:400:kworker.0 00000100:00080000:0.0:1787574389.499026:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574389.499029:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574389.499064:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346763264:0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.499088:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574389.499113:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346763264 00000100:00100000:0.0:1787574389.499117:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346763264 00000100:00100000:0.0:1787574389.499142:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787574389.499148:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346763264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.499183:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346763264:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574389.499188:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1787574389.499201:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787574389.499230:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec3800 x1874407346763264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574389.499258:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346763264:0@lo:400:kworker.0 00000100:00100000:1.0:1787574389.499398:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787574389.499406:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346762880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574389.499411:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787574389.499418:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346763008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574389.499484:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346762880:12345-0@lo:400:kworker.0 Request processed in 79us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574389.499497:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787574389.499571:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346763008:12345-0@lo:400:kworker.0 Request processed in 153us (629us total) trans 0 rc 0/0 00010000:00080000:2.0:1787574389.499572:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec1880 x1874407346763008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574389.499578:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787574389.499582:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346763008:0@lo:400:kworker.0 00010000:00080000:2.0:1787574389.499591:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bec2680 x1874407346762880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574389.499611:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346762880:0@lo:400:kworker.0 00000100:00100000:0.0:1787574390.028232:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574390.028319:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574390.028351:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574390.028383:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323610752 00000100:00100000:0.0:1787574390.028395:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323610752 00000100:00100000:0.0:1787574390.028467:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 297 00000100:00100000:0.0:1787574390.028479:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2404:x1874407323610752:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574390.028554:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2404:x1874407323610752:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574390.028562:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 297 00000100:00100000:0.0:1787574390.028597:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323610880 00000100:00100000:0.0:1787574390.028601:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323610880 00000100:00100000:0.0:1787574390.028636:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323611008 00000100:00100000:0.0:1787574390.028639:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323611008 00000100:00100000:0.0:1787574390.028661:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:0.0:1787574390.028667:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323610880:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574390.028701:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323610880:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574390.028723:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:0.0:1787574390.028736:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:0.0:1787574390.028742:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323611008:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574390.028768:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323611008:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574390.028775:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00080000:0.0:1787574390.028909:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574390.028913:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787574390.451539:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574391.474094:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574392.497483:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574392.561638:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574392.561662:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346763392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574392.561739:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574392.561927:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346763392 00000100:00100000:3.0:1787574392.561954:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346763392 00000100:00080000:1.0:1787574392.562067:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574392.562337:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787574392.562355:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346763392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574392.562399:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574392.562488:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346763392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574392.562498:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1787574392.562564:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034dd180 x1874407346763392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574392.562590:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346763392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574392.570028:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574392.570061:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346763520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574392.570168:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574392.570412:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346763520 00000100:00100000:1.0:1787574392.570423:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346763520 00000100:00100000:1.0:1787574392.570495:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787574392.570506:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346763520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574392.570536:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574392.570746:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346763520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574392.570757:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787574392.570789:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787574392.570826:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505500 x1874407346763520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574392.570849:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346763520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787574393.527621:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787574393.653542:0:11989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:26:31 (1787574391) === 00000100:00100000:0.0:1787574394.100399:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346763648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574394.100487:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574394.101154:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346763648 00000100:00100000:3.0:1787574394.101173:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346763648 00000100:00100000:3.0:1787574394.101307:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787574394.101320:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346763648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574394.101370:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787574394.101495:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346763648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 178us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574394.101504:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787574394.101609:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346763648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574394.367661:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574394.367869:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323611136 00000100:00100000:1.0:1787574394.367884:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323611136 00000100:00100000:1.0:1787574394.367966:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 298 00000100:00100000:1.0:1787574394.367981:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:8752:x1874407323611136:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787574394.368029:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574394.368053:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7fb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b586 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574394.368089:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b586 expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574394.368101:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b586 expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574394.368112:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74000, rc 0) 00000100:00100000:1.0:1787574394.368191:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8752:x1874407323611136:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 215us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.368199:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 298 00000100:00100000:0.0:1787574394.377720:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574394.378474:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323611264 00000100:00100000:2.0:1787574394.378492:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323611264 00000100:00100000:2.0:1787574394.378576:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 299 00000100:00100000:2.0:1787574394.378590:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8752:x1874407323611264:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787574394.378791:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8752:x1874407323611264:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 205us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574394.378797:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 299 00000100:00100000:3.0:1787574394.383399:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574394.383554:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323611392 00000100:00100000:0.0:1787574394.383568:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323611392 00000100:00100000:0.0:1787574394.383655:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 300 00000100:00100000:0.0:1787574394.383669:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8752:x1874407323611392:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787574394.383894:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8752:x1874407323611392:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 227us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.383904:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 300 00000100:00100000:0.0:1787574394.404810:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574394.405034:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323611520 00000100:00100000:1.0:1787574394.405051:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323611520 00000100:00100000:1.0:1787574394.405140:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 301 00000100:00100000:1.0:1787574394.405153:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8756:x1874407323611520:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574394.405441:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8756:x1874407323611520:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 291us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.405451:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 301 00000100:00100000:3.0:1787574394.472212:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574394.472445:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323611648 00000100:00100000:2.0:1787574394.472459:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323611648 00000100:00100000:2.0:1787574394.472537:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 302 00000100:00100000:2.0:1787574394.472550:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8756:x1874407323611648:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574394.474467:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8756:x1874407323611648:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 1908us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574394.474482:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 302 00000100:00100000:2.0:1787574394.498279:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574394.500591:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323611776 00000100:00100000:0.0:1787574394.500612:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323611776 00000100:00100000:0.0:1787574394.500710:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 303 00000100:00100000:0.0:1787574394.500724:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8756:x1874407323611776:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574394.501176:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8756:x1874407323611776:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 447us (2937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.501186:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 303 00000100:00100000:0.0:1787574394.514885:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574394.520010:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323611904 00000100:00100000:2.0:1787574394.520038:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323611904 00000100:00100000:2.0:1787574394.520203:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 304 00000100:00100000:2.0:1787574394.520216:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:8752:x1874407323611904:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787574394.520274:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574394.520324:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b5b7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574394.520379:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5b7 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574394.520392:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5b7 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574394.520404:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82200, rc 0) 00000100:00100000:2.0:1787574394.520508:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:8752:x1874407323611904:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 295us (5639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574394.520516:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 304 00000100:00100000:3.0:1787574394.526718:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574394.526799:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323612032 00000100:00100000:1.0:1787574394.526814:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323612032 00000100:00100000:1.0:1787574394.526883:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 305 00000100:00100000:1.0:1787574394.526911:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:8752:x1874407323612032:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787574394.526949:0:6501:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787574394.526976:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787574394.526981:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787574394.526985:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787574394.526988:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787574394.526991:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1787574394.541497:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:8752:x1874407323612032:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 14576us (14782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.541516:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 305 00010000:00010000:1.0:1787574394.545809:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574394.550943:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574394.551214:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323612160 00000100:00100000:3.0:1787574394.551228:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323612160 00000100:00100000:3.0:1787574394.551358:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 306 00000100:00100000:3.0:1787574394.551372:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:8752:x1874407323612160:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787574394.551394:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574394.551417:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7fc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b5be expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574394.551454:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5be expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574394.551467:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5be expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574394.551479:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030800, rc 0) 00000100:00100000:3.0:1787574394.551558:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:8752:x1874407323612160:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 189us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574394.551566:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 306 00000100:00100000:3.0:1787574394.558129:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574394.558390:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323612288 00000100:00100000:1.0:1787574394.558405:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323612288 00000100:00100000:1.0:1787574394.558478:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 307 00000100:00100000:1.0:1787574394.558491:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:8752:x1874407323612288:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787574394.558723:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:8752:x1874407323612288:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 233us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.558731:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 307 00000100:00100000:2.0:1787574394.573553:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574394.573970:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323612416 00000100:00100000:3.0:1787574394.573985:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323612416 00000100:00100000:3.0:1787574394.574076:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 308 00000100:00100000:3.0:1787574394.574089:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:8752:x1874407323612416:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787574394.575819:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:8752:x1874407323612416:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 1719us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.575834:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 308 00000100:00100000:0.0:1787574394.580999:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574394.581095:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323612544 00000100:00100000:1.0:1787574394.581109:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323612544 00000100:00100000:1.0:1787574394.581183:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 309 00000100:00100000:1.0:1787574394.581197:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:8761:x1874407323612544:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574394.581562:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:8761:x1874407323612544:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 367us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.581571:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 309 00000100:00100000:3.0:1787574394.591785:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574394.593290:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323612672 00000100:00100000:0.0:1787574394.593311:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323612672 00000100:00100000:0.0:1787574394.593412:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 310 00000100:00100000:0.0:1787574394.593425:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:8761:x1874407323612672:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574394.593843:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:8761:x1874407323612672:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 419us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.593852:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 310 00000100:00100000:0.0:1787574394.611258:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346763776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574394.611363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574394.611468:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346763776 00000100:00100000:0.0:1787574394.611477:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346763776 00000100:00100000:3.0:1787574394.611491:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346763904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574394.611528:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574394.611542:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787574394.611555:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346763776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574394.611562:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346763904 00000100:00100000:3.0:1787574394.611581:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346763904 00002000:00000024:0.0:1787574394.611590:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574394.611611:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787574394.611617:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346763904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574394.611749:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574394.611838:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346763904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 221us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574394.611846:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787574394.611899:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346763904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574394.612031:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346764416:0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.612049:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346763776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 497us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574394.612058:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574394.612065:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787574394.612077:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346764928:0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.612088:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346764032:0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.612120:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574394.612144:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346764544:0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.612166:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574394.612183:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346765056:0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.612204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787574394.612234:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574394.612275:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346764416 00000100:00100000:0.0:1787574394.612280:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346764416 00000100:00100000:0.0:1787574394.612318:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346764544 00000100:00100000:0.0:1787574394.612322:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346764544 00000100:00100000:0.0:1787574394.612340:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346765056 00000100:00100000:0.0:1787574394.612343:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346765056 00000100:00100000:0.0:1787574394.612360:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787574394.612366:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346764416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.612401:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346764416:12345-0@lo:400:kworker.0 Request processed in 35us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.612408:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787574394.612422:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787574394.612428:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346764544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.612462:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346764544:12345-0@lo:400:kworker.0 Request processed in 34us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.612468:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787574394.612479:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787574394.612484:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346765056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.612521:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346765056:12345-0@lo:400:kworker.0 Request processed in 37us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.612528:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1787574394.612552:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574394.612556:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787574394.612580:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8c380 x1874407346764544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574394.612604:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346764544:0@lo:400:kworker.0 00010000:00080000:0.0:1787574394.612616:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8c000 x1874407346765056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574394.612709:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574394.612738:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346764416:0@lo:400:kworker.0 00000100:00100000:3.0:1787574394.612759:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346764928 00000100:00100000:3.0:1787574394.612763:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346764928 00000100:00100000:3.0:1787574394.612794:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787574394.612801:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346764928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574394.612836:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346764928:12345-0@lo:400:kworker.0 Request processed in 35us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574394.612842:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787574394.612871:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346764928:0@lo:400:kworker.0 00000100:00080000:3.0:1787574394.612885:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574394.612934:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574394.612955:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574394.612994:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574394.613042:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323613056 00000100:00100000:3.0:1787574394.613046:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323613056 00000100:00100000:3.0:1787574394.613071:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323612928 00000100:00100000:3.0:1787574394.613074:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323612928 00000100:00100000:1.0:1787574394.613219:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346764160:0@lo:400:kworker.0 00000100:00100000:1.0:1787574394.613278:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574394.613297:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346764672:0@lo:400:kworker.0 00000100:00100000:1.0:1787574394.613335:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574394.613355:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346765184:0@lo:400:kworker.0 00000100:00100000:1.0:1787574394.613376:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574394.613396:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787574394.613402:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346764288:0@lo:400:kworker.0 00000100:00100000:1.0:1787574394.613425:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574394.613437:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346764800:0@lo:400:kworker.0 00000100:00100000:1.0:1787574394.613455:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574394.613473:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346765312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574394.613496:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574394.613523:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346764672 00000100:00100000:1.0:1787574394.613527:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346764672 00000100:00100000:1.0:1787574394.613559:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346765184 00000100:00100000:1.0:1787574394.613562:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346765184 00000100:00100000:1.0:1787574394.613577:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346764800 00000100:00100000:1.0:1787574394.613580:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346764800 00000100:00100000:1.0:1787574394.613606:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787574394.613616:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346764672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574394.613669:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346764672:12345-0@lo:400:kworker.0 Request processed in 56us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.613677:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787574394.613692:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787574394.613697:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346765184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574394.613720:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346765184:12345-0@lo:400:kworker.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.613725:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787574394.613743:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787574394.613749:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346764800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574394.613773:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346764800:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.613779:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1787574394.613818:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8d180 x1874407346764800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574394.613829:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346764800:0@lo:400:kworker.0 00010000:00080000:1.0:1787574394.613840:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8ce00 x1874407346764672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574394.613848:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346764672:0@lo:400:kworker.0 00010000:00080000:1.0:1787574394.613857:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8ca80 x1874407346765184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574394.613870:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346765184:0@lo:400:kworker.0 00000100:00100000:1.0:1787574394.613907:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346764032 00000100:00100000:1.0:1787574394.613912:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346764032 00000100:00100000:1.0:1787574394.613949:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787574394.613956:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346764032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574394.613988:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346764032:12345-0@lo:400:kworker.0 Request processed in 34us (1868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.613994:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00080000:1.0:1787574394.614063:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025fce00 x1874407346763776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574394.614079:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346763776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574394.614142:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346765312 00000100:00100000:1.0:1787574394.614147:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346765312 00000100:00100000:1.0:1787574394.614172:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574394.614179:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346765312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787574394.614192:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574394.614231:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346765312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.614237:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574394.614291:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323612800 00000100:00100000:1.0:1787574394.614295:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323612800 00000100:00100000:1.0:1787574394.614308:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346764160 00000100:00100000:1.0:1787574394.614311:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346764160 00000100:00100000:1.0:1787574394.614324:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346764288 00000100:00100000:1.0:1787574394.614327:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346764288 00000100:00100000:0.0:1787574394.614857:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346765056:0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.614890:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346764032:0@lo:400:kworker.0 00000100:00100000:1.0:1787574394.616063:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:1.0:1787574394.616102:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323613056:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574394.616221:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323613056:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 134us (3287us total) trans 0 rc 0/0 00010000:00080000:0.0:1787574394.621191:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025fdc00 x1874407346765312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574394.621229:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346765312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574394.621360:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574394.625988:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1787574394.626019:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874407323612800:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787574394.626375:0:11515:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0874c266-15f3-4d8d-abed-9d908d92af46@192.168.202.40@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:0.0:1787574394.626440:0:11515:0:(genops.c:1385:class_connect()) connect: client 0874c266-15f3-4d8d-abed-9d908d92af46, cookie 0xd18a1efeeddb7fc9 00000004:00100000:0.0:1787574394.626479:0:11515:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787574394.626652:0:11515:0:(import.c:65:import_set_state_nolock()) ffff9ca4033df800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574394.626760:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+6:2401:x1874407323612800:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 746us (13763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.626772:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1787574394.626828:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323613312 00000100:00100000:0.0:1787574394.626836:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323613312 00000100:00100000:0.0:1787574394.626864:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787574394.626874:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346764160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.626960:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346764160:12345-0@lo:400:kworker.0 Request processed in 89us (13682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.626967:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787574394.627033:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346764160:0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.627066:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787574394.627073:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346764288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.627125:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346764288:12345-0@lo:400:kworker.0 Request processed in 53us (13699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.627132:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787574394.627159:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346764288:0@lo:400:kworker.0 00000100:00100000:0.0:1787574394.627183:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:0.0:1787574394.627188:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874407323613312:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787574394.627213:0:11515:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0874c266-15f3-4d8d-abed-9d908d92af46@192.168.202.40@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:0.0:1787574394.627270:0:11515:0:(genops.c:1385:class_connect()) connect: client 0874c266-15f3-4d8d-abed-9d908d92af46, cookie 0xd18a1efeeddb7fd0 00000004:00100000:0.0:1787574394.627286:0:11515:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787574394.627367:0:11515:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574394.627397:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+6:2401:x1874407323613312:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 207us (6041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.627404:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00080000:0.0:1787574394.631473:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574394.631489:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574394.631517:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574394.631521:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574394.636187:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:3.0:1787574394.636217:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323612928:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574394.639135:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323612928:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 2914us (26159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574394.639156:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:0.0:1787574394.639170:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574394.639201:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323613440 00000100:00100000:3.0:1787574394.639211:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323613440 00000100:00100000:0.0:1787574394.639284:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574394.639299:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323613184 00000100:00100000:3.0:1787574394.639303:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323613184 00000100:00100000:0.0:1787574394.639311:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:3.0:1787574394.639321:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1787574394.639323:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+6:0:x1874407323613440:12345-192.168.202.40@tcp:41:mount.lustre.0 00000100:00100000:3.0:1787574394.639326:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+6:0:x1874407323613184:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787574394.639357:0:8610:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000004:00000024:0.0:1787574394.639357:0:11515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574394.639425:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+6:0:x1874407323613184:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 97us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574394.639431:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00080000:3.0:1787574394.639454:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574394.639459:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574394.641362:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+6:0:x1874407323613440:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 2025us (2176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574394.641379:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1787574394.642861:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:3.0:1787574394.648810:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574394.660406:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323613568 00000100:00100000:1.0:1787574394.660428:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323613568 00000100:00100000:1.0:1787574394.660538:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:1.0:1787574394.660553:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+6:8752:x1874407323613568:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787574394.660608:0:8610:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787574394.660750:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+6:8752:x1874407323613568:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 199us (11957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.660761:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1787574394.665893:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574394.666057:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323613696 00000100:00100000:2.0:1787574394.666074:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323613696 00000100:00100000:2.0:1787574394.666226:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1787574394.666298:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+6:8752:x1874407323613696:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787574394.666687:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+6:8752:x1874407323613696:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 448us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574394.666698:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1787574394.671902:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574394.671963:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574394.672010:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323613824 00000100:00100000:3.0:1787574394.672023:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323613824 00000100:00100000:3.0:1787574394.672088:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1787574394.672118:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874407323613824:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787574394.672166:0:8423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0874c266-15f3-4d8d-abed-9d908d92af46@192.168.202.40@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:3.0:1787574394.672217:0:8423:0:(genops.c:1385:class_connect()) connect: client 0874c266-15f3-4d8d-abed-9d908d92af46, cookie 0xd18a1efeeddb7fd7 00002000:00100000:3.0:1787574394.672235:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0874c266-15f3-4d8d-abed-9d908d92af46/ffff9ca53bf11800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787574394.672300:0:8423:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787574394.672422:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787574394.672463:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9ca53bf12800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574394.672551:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0874c266-15f3-4d8d-abed-9d908d92af46+6:2401:x1874407323613824:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 434us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574394.672560:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1787574394.672622:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574394.672757:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323613952 00000100:00100000:3.0:1787574394.672762:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323613952 00000100:00100000:3.0:1787574394.672787:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1787574394.672793:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874407323613952:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787574394.672817:0:8619:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0874c266-15f3-4d8d-abed-9d908d92af46@192.168.202.40@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:3.0:1787574394.672842:0:8619:0:(genops.c:1385:class_connect()) connect: client 0874c266-15f3-4d8d-abed-9d908d92af46, cookie 0xd18a1efeeddb7fde 00002000:00100000:3.0:1787574394.672852:0:8619:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0874c266-15f3-4d8d-abed-9d908d92af46/ffff9ca53bf17000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787574394.672860:0:8619:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787574394.674255:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323614080 00000100:00100000:1.0:1787574394.674274:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323614080 00000100:00100000:1.0:1787574394.674370:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:1.0:1787574394.674382:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0874c266-15f3-4d8d-abed-9d908d92af46+6:8752:x1874407323614080:12345-192.168.202.40@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787574394.674490:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0874c266-15f3-4d8d-abed-9d908d92af46+6:8752:x1874407323614080:12345-192.168.202.40@tcp:900:mount.lustre.0 Request processed in 111us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.674499:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00002000:00080000:1.0:1787574394.676922:0:8619:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787574394.676990:0:8619:0:(import.c:65:import_set_state_nolock()) ffff9ca4035e1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574394.678089:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0874c266-15f3-4d8d-abed-9d908d92af46+6:2401:x1874407323613952:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 5283us (5455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.678104:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1787574394.678317:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574394.678608:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323614208 00000100:00100000:1.0:1787574394.678619:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323614208 00000100:00100000:1.0:1787574394.678680:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1787574394.678690:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0874c266-15f3-4d8d-abed-9d908d92af46+6:8752:x1874407323614208:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787574394.678810:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787574394.678897:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0874c266-15f3-4d8d-abed-9d908d92af46+6:8752:x1874407323614208:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 207us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574394.678905:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00010000:00010000:2.0:1787574395.570273:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574396.594736:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574397.618420:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574397.685511:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346765440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574397.685589:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574397.685726:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346765440 00000100:00100000:0.0:1787574397.685736:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346765440 00000100:00080000:1.0:1787574397.685833:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574397.685868:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787574397.685881:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346765440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574397.685910:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574397.685972:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346765440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574397.685989:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1787574397.686060:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505500 x1874407346765440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574397.686080:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346765440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574397.686342:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574397.686360:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346765568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574397.686395:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574397.686471:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346765568 00000100:00100000:0.0:1787574397.686476:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346765568 00000100:00100000:0.0:1787574397.686518:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787574397.686526:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346765568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574397.686538:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574397.686575:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346765568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574397.686581:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1787574397.686612:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402505500 x1874407346765568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574397.686634:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346765568:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787574397.686687:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787574398.643050:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574399.222453:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574399.222485:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346765696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574399.222580:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574399.222661:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346765696 00000100:00100000:1.0:1787574399.222672:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346765696 00000100:00100000:1.0:1787574399.222735:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787574399.222746:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346765696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787574399.222795:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787574399.222852:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346765696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574399.222859:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787574399.222919:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346765696:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787574399.665872:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574399.729818:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346765824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574399.729928:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574399.730027:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346766336:0@lo:400:kworker.0 00000100:00100000:2.0:1787574399.730054:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574399.730076:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346766848:0@lo:400:kworker.0 00000100:00100000:2.0:1787574399.730099:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574399.730133:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346767360:0@lo:400:kworker.0 00000100:00100000:2.0:1787574399.730155:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574399.730177:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787574399.730183:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346766208:0@lo:400:kworker.0 00000100:00100000:2.0:1787574399.730205:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574399.730221:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346766720:0@lo:400:kworker.0 00000100:00100000:2.0:1787574399.730274:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574399.730291:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346767232:0@lo:400:kworker.0 00000100:00100000:2.0:1787574399.730312:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574399.730398:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346765824 00000100:00100000:3.0:1787574399.730407:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346765824 00000100:00100000:3.0:1787574399.730465:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346766336 00000100:00100000:3.0:1787574399.730468:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346766336 00000100:00100000:3.0:1787574399.730495:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787574399.730507:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346765824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574399.730540:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787574399.730632:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346765952:0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.730706:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574399.730741:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346766464:0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.730768:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574399.730863:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787574399.730880:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346766336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574399.730885:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346765952 00000100:00100000:2.0:1787574399.730893:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346765952 00000100:00100000:2.0:1787574399.730940:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1787574399.730949:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346765952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.740792:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346766976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574399.740899:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574399.740952:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346767488:0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.740988:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574399.741027:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787574399.741035:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346766080:0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.741066:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574399.741109:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346765824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10592us (11169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.741126:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787574399.741186:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346766848 00000100:00100000:3.0:1787574399.741197:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346766848 00000100:00100000:3.0:1787574399.741284:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346767360 00000100:00100000:3.0:1787574399.741288:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346767360 00000100:00100000:3.0:1787574399.741302:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346766720 00000100:00100000:3.0:1787574399.741305:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346766720 00000100:00100000:3.0:1787574399.741318:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346767488 00000100:00100000:3.0:1787574399.741321:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346767488 00000100:00100000:3.0:1787574399.741336:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787574399.741345:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346766848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.741422:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346766848:12345-0@lo:400:kworker.0 Request processed in 78us (11322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.741429:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787574399.741441:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787574399.741447:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346767360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.741507:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346767360:12345-0@lo:400:kworker.0 Request processed in 60us (11351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.741513:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787574399.741526:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787574399.741532:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346766720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.741773:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346766720:12345-0@lo:400:kworker.0 Request processed in 46us (11302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.741780:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787574399.741794:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787574399.741801:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346767488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.741832:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346767488:12345-0@lo:400:kworker.0 Request processed in 32us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.741838:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787574399.741860:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574399.741864:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787574399.741915:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5045a9c00 x1874407346766720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574399.741930:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346766720:0@lo:400:kworker.0 00010000:00080000:3.0:1787574399.741943:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40345fb80 x1874407346767360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574399.741950:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346767360:0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.741979:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346765824:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1787574399.741992:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5045a9500 x1874407346766848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574399.742000:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346766848:0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.742068:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346766208 00000100:00100000:3.0:1787574399.742073:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346766208 00000100:00100000:3.0:1787574399.742102:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346767232 00000100:00100000:3.0:1787574399.742105:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346767232 00000100:00100000:3.0:1787574399.742133:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346766464 00000100:00100000:3.0:1787574399.742137:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346766464 00000100:00100000:3.0:1787574399.742148:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346766080 00000100:00100000:3.0:1787574399.742151:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346766080 00000100:00100000:3.0:1787574399.742163:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787574399.742170:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346766208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.742212:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346766208:12345-0@lo:400:kworker.0 Request processed in 42us (12005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.742218:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787574399.742230:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787574399.742235:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346767232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.742286:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346767232:12345-0@lo:400:kworker.0 Request processed in 51us (11973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.742292:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787574399.742304:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787574399.742310:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346766464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.742337:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346766464:12345-0@lo:400:kworker.0 Request processed in 27us (11568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.742343:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787574399.742353:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787574399.742359:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346766080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.742385:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346766080:12345-0@lo:400:kworker.0 Request processed in 27us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.742391:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1787574399.742413:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574399.742416:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574399.742434:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346766208:0@lo:400:kworker.0 00010000:00080000:3.0:1787574399.742455:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5045a8700 x1874407346767232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574399.742464:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346767232:0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.743011:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346767616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574399.743049:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574399.743101:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346766976 00000100:00100000:3.0:1787574399.743106:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346766976 00000100:00100000:3.0:1787574399.743134:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346767616 00000100:00100000:3.0:1787574399.743137:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346767616 00000100:00100000:3.0:1787574399.743149:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787574399.743156:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346766976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574399.743177:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574399.743212:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346766976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.743217:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787574399.743230:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787574399.743235:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346767616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574399.743270:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574399.743299:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346767616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.743305:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1787574399.743330:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402692300 x1874407346767616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574399.743344:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346767616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574399.743687:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346766080:0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.743703:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346766592:0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.743757:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574399.743777:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346767104:0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.743799:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574399.743834:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346766464:0@lo:400:kworker.0 00010000:00080000:0.0:1787574399.743849:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402691180 x1874407346766976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574399.743867:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346766976:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787574399.743897:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40345c380 x1874407346767488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574399.743904:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346767488:0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.743972:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346766592 00000100:00100000:0.0:1787574399.743978:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346766592 00000100:00100000:0.0:1787574399.744031:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346767104 00000100:00100000:0.0:1787574399.744034:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346767104 00000100:00100000:0.0:1787574399.744058:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787574399.744067:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346766592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574399.744101:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787574399.744121:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346766592:12345-0@lo:400:kworker.0 Request processed in 53us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.744130:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346767104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.744132:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1787574399.744168:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574399.744174:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787574399.744208:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5045a8a80 x1874407346766592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574399.744210:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346767104:12345-0@lo:400:kworker.0 Request processed in 82us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.744272:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787574399.744276:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346766592:0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.744300:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346767104:0@lo:400:kworker.0 00000100:00100000:1.0:1787574399.749606:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346766336:12345-0@lo:400:kworker.0 Request processed in 18716us (19533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574399.749626:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787574399.749825:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346766336:0@lo:400:kworker.0 00000100:00100000:2.0:1787574399.751419:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346765952:12345-0@lo:400:kworker.0 Request processed in 20462us (20704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574399.751433:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787574399.752560:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346765952:0@lo:400:kworker.0 00000100:00100000:0.0:1787574399.754884:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574399.754921:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574399.754951:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574399.755001:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574399.755035:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323614464 00000100:00100000:0.0:1787574399.755038:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574399.755052:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323614464 00000100:00100000:0.0:1787574399.755066:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574399.755139:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574399.755147:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323614720 00000100:00100000:1.0:1787574399.755152:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323614720 00000100:00100000:0.0:1787574399.755182:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323614976 00000100:00100000:1.0:1787574399.755188:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323614592 00000100:00100000:0.0:1787574399.755194:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323614976 00000100:00100000:1.0:1787574399.755195:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323614592 00000100:00100000:1.0:1787574399.755221:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323614848 00000100:00100000:1.0:1787574399.755279:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323614848 00000100:00100000:0.0:1787574399.755306:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323615104 00000100:00100000:0.0:1787574399.755312:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323615104 00000100:00100000:1.0:1787574399.755320:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:1.0:1787574399.755343:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323614464:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574399.755353:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:0.0:1787574399.755367:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0874c266-15f3-4d8d-abed-9d908d92af46+6:2405:x1874407323614976:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574399.755448:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323614464:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 115us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574399.755460:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:1.0:1787574399.755487:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00100000:1.0:1787574399.755497:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+6:2405:x1874407323614720:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574399.755504:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:2.0:1787574399.755520:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0874c266-15f3-4d8d-abed-9d908d92af46+6:2405:x1874407323615104:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574399.755587:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 181 00000100:00100000:3.0:1787574399.755607:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323614592:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574399.757559:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0874c266-15f3-4d8d-abed-9d908d92af46+6:2405:x1874407323614976:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 2185us (2594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574399.757576:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+6:2405:x1874407323614720:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 2066us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574399.757599:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00100000:0.0:1787574399.757608:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:1.0:1787574399.757657:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:1.0:1787574399.757676:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+6:2405:x1874407323614848:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574399.757719:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323614336 00000100:00100000:0.0:1787574399.757727:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323614336 00000100:00100000:0.0:1787574399.757772:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 313 00000100:00100000:0.0:1787574399.757781:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323614336:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574399.757822:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+6:2405:x1874407323614848:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 152us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574399.757832:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:0.0:1787574399.757842:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323614336:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 53us (2833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574399.757853:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 313 00000100:00080000:0.0:1787574399.757889:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574399.757895:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574399.757898:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574399.757901:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574399.759379:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323614592:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 3772us (4330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574399.759395:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 181 00000100:00100000:2.0:1787574399.759830:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0874c266-15f3-4d8d-abed-9d908d92af46+6:2405:x1874407323615104:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 4312us (4689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574399.759854:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00010000:00010000:1.0:1787574400.689742:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787574400.760933:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0874c266-15f3-4d8d-abed-9d908d92af46 00000001:00100000:2.0:1787574400.761058:0:6488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0874c266-15f3-4d8d-abed-9d908d92af46 00000001:00100000:3.0:1787574400.761409:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0874c266-15f3-4d8d-abed-9d908d92af46 00000001:00100000:1.0:1787574400.761874:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0874c266-15f3-4d8d-abed-9d908d92af46 00010000:00010000:1.0:1787574401.713690:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787574401.762792:0:12184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787574402.739540:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574402.801454:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574402.801486:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346767744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574402.801583:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574402.801684:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346767744 00000100:00100000:3.0:1787574402.801694:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346767744 00000100:00100000:3.0:1787574402.801762:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787574402.801775:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346767744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574402.801812:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574402.801877:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346767744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574402.801884:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1787574402.801966:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402692300 x1874407346767744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574402.801989:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346767744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574402.802559:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346767872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574402.802621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574402.802804:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346767872 00000100:00100000:3.0:1787574402.802811:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346767872 00000100:00100000:3.0:1787574402.802862:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787574402.802871:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346767872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574402.802897:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574402.802947:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346767872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574402.802955:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1787574402.803138:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402692300 x1874407346767872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574402.803155:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346767872:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787574402.803763:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787574403.764296:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574404.338938:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574404.338960:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346768000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574404.339030:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574404.339140:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346768000 00000100:00100000:0.0:1787574404.339149:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346768000 00000100:00100000:0.0:1787574404.339212:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787574404.339223:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346768000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574404.339289:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574404.339340:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346768000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574404.339347:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787574404.339558:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346768000:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574404.790389:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574404.849759:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346768512:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.849845:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.849938:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346769024:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.849966:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.849988:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346769536:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850007:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.850033:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787574404.850039:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346768128:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850065:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.850082:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346768640:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850103:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.850121:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346769152:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850139:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.850154:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346769664:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850172:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.850198:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346768384:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850220:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.850262:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346768896:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850285:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.850303:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346769408:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850324:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.850342:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787574404.850348:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346768256:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850393:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.850410:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346768768:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850429:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.850447:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346769280:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850468:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.850490:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346768640 00000100:00100000:1.0:1787574404.850497:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346768640 00000100:00100000:1.0:1787574404.850545:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346768384 00000100:00100000:1.0:1787574404.850548:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346768384 00000100:00100000:1.0:1787574404.850649:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787574404.850657:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346768640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850713:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346768640:12345-0@lo:400:kworker.0 Request processed in 55us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.850719:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787574404.850738:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787574404.850744:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346768384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850776:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346768384:12345-0@lo:400:kworker.0 Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.850782:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787574404.850800:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346769024 00000100:00100000:1.0:1787574404.850804:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346769024 00000100:00100000:1.0:1787574404.850829:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346769536 00000100:00100000:1.0:1787574404.850831:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346769536 00000100:00100000:1.0:1787574404.850842:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346769152 00000100:00100000:1.0:1787574404.850845:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346769152 00000100:00100000:1.0:1787574404.850855:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346769664 00000100:00100000:1.0:1787574404.850857:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346769664 00000100:00100000:1.0:1787574404.850869:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574404.850883:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346769024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850926:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346769024:12345-0@lo:400:kworker.0 Request processed in 44us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.850932:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574404.850944:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787574404.850950:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346769536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.850977:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346769536:12345-0@lo:400:kworker.0 Request processed in 28us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.850982:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787574404.850993:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787574404.850998:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346769152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.851021:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346769152:12345-0@lo:400:kworker.0 Request processed in 24us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.851027:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787574404.851044:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787574404.851049:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346769664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.851076:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346769664:12345-0@lo:400:kworker.0 Request processed in 27us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.851081:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787574404.851102:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346768512 00000100:00100000:1.0:1787574404.851105:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346768512 00000100:00100000:1.0:1787574404.851121:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346768896 00000100:00100000:1.0:1787574404.851123:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346768896 00000100:00100000:1.0:1787574404.851134:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346769408 00000100:00100000:1.0:1787574404.851136:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346769408 00000100:00100000:1.0:1787574404.851146:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346768256 00000100:00100000:1.0:1787574404.851148:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346768256 00000100:00100000:1.0:1787574404.851166:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346768768 00000100:00100000:1.0:1787574404.851169:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346768768 00000100:00100000:1.0:1787574404.851185:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346769280 00000100:00100000:1.0:1787574404.851189:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346769280 00000100:00100000:1.0:1787574404.851201:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787574404.851206:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346768512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.851237:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346768512:12345-0@lo:400:kworker.0 Request processed in 31us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574404.851262:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346769792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574404.851263:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787574404.851274:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787574404.851279:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346768896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574404.851294:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.851302:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346768896:12345-0@lo:400:kworker.0 Request processed in 24us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.851308:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787574404.851317:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574404.851318:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787574404.851323:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346769408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574404.851323:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346769920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574404.851344:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574404.851347:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346769408:12345-0@lo:400:kworker.0 Request processed in 24us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.851352:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787574404.851363:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787574404.851369:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346768256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574404.851379:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787574404.851387:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346768768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.851392:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346768256:12345-0@lo:400:kworker.0 Request processed in 25us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.851398:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787574404.851408:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787574404.851412:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346768768:12345-0@lo:400:kworker.0 Request processed in 28us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.851413:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346769280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574404.851418:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1787574404.851433:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574404.851438:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574404.851441:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574404.851443:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574404.851445:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346769280:12345-0@lo:400:kworker.0 Request processed in 32us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.851450:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787574404.851453:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346769792 00000100:00100000:0.0:1787574404.851456:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346769792 00000100:00100000:1.0:1787574404.851472:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346769920 00000100:00100000:1.0:1787574404.851475:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346769920 00000100:00100000:0.0:1787574404.851479:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787574404.851484:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346769792:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574404.851492:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787574404.851497:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346769920:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:0.0:1787574404.851506:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:1.0:1787574404.851514:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574404.851540:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346769920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.851546:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787574404.851605:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346768128 00000100:00100000:2.0:1787574404.851609:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346768128 00000100:00100000:2.0:1787574404.851639:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787574404.851647:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346768128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574404.851682:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346768128:12345-0@lo:400:kworker.0 Request processed in 36us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574404.851688:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787574404.852016:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574404.852027:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346770048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574404.852056:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574404.852130:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346770048 00000100:00100000:3.0:1787574404.852136:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346770048 00000100:00100000:3.0:1787574404.852158:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787574404.852164:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346770048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574404.852175:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574404.852225:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346770048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574404.852231:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1787574404.852369:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5045ab100 x1874407346770048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574404.852388:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346770048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574404.853349:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346768256:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.853363:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346768768:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.853374:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346769280:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.853385:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346768384:0@lo:400:kworker.0 00010000:00080000:1.0:1787574404.853398:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366d880 x1874407346768896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574404.853406:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346768896:0@lo:400:kworker.0 00010000:00080000:1.0:1787574404.853417:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366ed80 x1874407346769408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574404.853425:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346769408:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.853460:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346768128:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.853491:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346768640:0@lo:400:kworker.0 00010000:00080000:1.0:1787574404.853504:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366d500 x1874407346769152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574404.853512:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346769152:0@lo:400:kworker.0 00010000:00080000:1.0:1787574404.853524:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366ce00 x1874407346769664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574404.853531:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346769664:0@lo:400:kworker.0 00000100:00100000:1.0:1787574404.853542:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346768512:0@lo:400:kworker.0 00010000:00080000:1.0:1787574404.853552:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366c000 x1874407346769024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574404.853572:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346769024:0@lo:400:kworker.0 00010000:00080000:1.0:1787574404.853583:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366f480 x1874407346769536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574404.853590:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346769536:0@lo:400:kworker.0 00000100:00100000:0.0:1787574404.859325:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346769792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7827us (8017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574404.859340:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787574404.859733:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346769920:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1787574404.859757:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402691180 x1874407346769792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574404.859770:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346769792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574404.876216:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574404.876324:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574404.876351:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574404.876384:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574404.876403:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574404.876419:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574404.876445:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574404.876470:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323615488 00000100:00100000:1.0:1787574404.876478:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323615488 00000100:00100000:1.0:1787574404.876551:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323615744 00000100:00100000:1.0:1787574404.876555:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323615744 00000100:00100000:0.0:1787574404.876724:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323615232 00000100:00100000:0.0:1787574404.876729:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323615232 00000100:00100000:0.0:1787574404.876763:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 315 00000100:00100000:0.0:1787574404.876773:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323615232:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574404.876855:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323615232:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 84us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574404.876862:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 315 00000100:00100000:0.0:1787574404.876993:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323616000 00000100:00100000:0.0:1787574404.876997:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323616000 00000100:00100000:0.0:1787574404.877023:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323615872 00000100:00100000:0.0:1787574404.877025:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323615872 00000100:00100000:0.0:1787574404.877045:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:0.0:1787574404.877052:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323616000:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574404.877082:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323616000:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 31us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574404.877089:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:0.0:1787574404.877100:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:0.0:1787574404.877107:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323615872:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574404.877127:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323615872:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574404.877132:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00080000:0.0:1787574404.877189:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574404.877193:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574404.877195:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574404.877261:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323615616 00000100:00100000:0.0:1787574404.877265:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323615616 00000100:00100000:0.0:1787574404.877291:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:0.0:1787574404.877306:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323615488:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574404.877338:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323615488:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574404.877344:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:0.0:1787574404.877358:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:0.0:1787574404.877364:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323615744:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574404.877383:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323615744:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 19us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574404.877389:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:0.0:1787574404.877399:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00100000:0.0:1787574404.877404:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323615616:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574404.877422:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323615616:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 18us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574404.877428:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00080000:0.0:1787574404.877439:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574404.878316:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323615360 00000100:00100000:1.0:1787574404.878325:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323615360 00000100:00100000:1.0:1787574404.878418:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:1.0:1787574404.878426:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323615360:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574404.878480:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323615360:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 55us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574404.878491:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00080000:0.0:1787574404.878549:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787574405.809830:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574406.833460:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574407.857491:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574407.921403:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574407.921472:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346770176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574407.921575:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574407.921648:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346770176 00000100:00100000:3.0:1787574407.921667:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346770176 00000100:00100000:3.0:1787574407.921720:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787574407.921731:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346770176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574407.921761:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574407.921990:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346770176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574407.921998:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1787574407.922020:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787574407.922048:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5045a8380 x1874407346770176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574407.922066:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346770176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574407.922331:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346770304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574407.922363:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574407.922505:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346770304 00000100:00100000:3.0:1787574407.922509:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346770304 00000100:00100000:3.0:1787574407.922547:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787574407.922554:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346770304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574407.922565:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574407.922598:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346770304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574407.922604:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1787574407.922627:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5045a8380 x1874407346770304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574407.922639:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346770304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787574407.922748:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787574408.883325:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574409.460495:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574409.460531:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346770432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574409.460648:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.461476:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346770432 00000100:00100000:1.0:1787574409.461485:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346770432 00000100:00100000:1.0:1787574409.461545:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787574409.461554:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346770432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787574409.461587:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787574409.461650:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346770432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.461657:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787574409.461822:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346770432:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574409.914478:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787574409.939670:0:12501:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787574409.939862:0:12501:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787574409.984644:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346770560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574409.984773:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.984848:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574409.984856:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346770688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574409.984894:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574409.985454:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346770688 00000100:00100000:0.0:1787574409.985463:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346770688 00000100:00100000:0.0:1787574409.985525:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787574409.985538:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346770688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574409.985567:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574409.985613:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346770688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574409.985636:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1787574409.986977:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787574409.987029:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf4b480 x1874407346770688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574409.987078:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346770688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574409.992455:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346770560 00000100:00100000:3.0:1787574409.992486:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346770560 00000100:00100000:3.0:1787574409.992568:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787574409.992579:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346770560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574409.992615:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574409.992746:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346770560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (7972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574409.992754:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787574409.992990:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346770816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574409.993044:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.993084:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346771328:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.993111:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.993132:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346771840:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.993155:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.993178:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787574409.993185:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346770944:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.993210:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.993231:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346771456:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.993277:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.993296:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346771968:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.993315:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.993348:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346770816 00000100:00100000:1.0:1787574409.993353:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346770816 00000100:00100000:1.0:1787574409.993391:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787574409.993398:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346770816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574409.993413:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574409.993448:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346770816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.993454:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787574409.993476:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346771328 00000100:00100000:1.0:1787574409.993479:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346771328 00000100:00100000:1.0:1787574409.993529:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346771456 00000100:00100000:1.0:1787574409.993533:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346771456 00000100:00100000:1.0:1787574409.993550:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346771968 00000100:00100000:1.0:1787574409.993553:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346771968 00000100:00100000:1.0:1787574409.993566:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787574409.993570:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346771328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.993602:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346771328:12345-0@lo:400:kworker.0 Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.993608:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787574409.993619:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787574409.993624:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346771456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.993648:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346771456:12345-0@lo:400:kworker.0 Request processed in 24us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.993654:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787574409.993666:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787574409.993671:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346771968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.993697:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346771968:12345-0@lo:400:kworker.0 Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.993702:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787574409.993720:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346771840 00000100:00100000:1.0:1787574409.993724:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346771840 00000100:00100000:1.0:1787574409.993751:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787574409.993758:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346771840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.993802:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346771840:12345-0@lo:400:kworker.0 Request processed in 45us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.993808:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787574409.993827:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346770944 00000100:00100000:1.0:1787574409.993837:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346770944 00000100:00100000:1.0:1787574409.993873:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787574409.993881:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346770944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.993910:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346770944:12345-0@lo:400:kworker.0 Request processed in 31us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.993916:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:1.0:1787574409.993961:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574409.993967:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574409.993969:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574409.993991:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346770944:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994003:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346771456:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994012:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346771968:0@lo:400:kworker.0 00010000:00080000:1.0:1787574409.994023:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf4a680 x1874407346770816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574409.994038:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346770816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574409.994047:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346771328:0@lo:400:kworker.0 00010000:00080000:1.0:1787574409.994057:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf4b480 x1874407346771840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574409.994065:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346771840:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994099:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346771072:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994128:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.994146:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346771584:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994164:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.994187:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346772096:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994205:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.994228:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346770560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574409.994266:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787574409.994273:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346771200:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994294:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.994312:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346771712:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994330:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.994345:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346772224:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994360:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574409.994385:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346771200 00000100:00100000:1.0:1787574409.994389:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346771200 00000100:00100000:1.0:1787574409.994412:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787574409.994418:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346771200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994453:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346771200:12345-0@lo:400:kworker.0 Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.994458:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787574409.994476:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346771712 00000100:00100000:1.0:1787574409.994479:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346771712 00000100:00100000:1.0:1787574409.994501:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346772224 00000100:00100000:1.0:1787574409.994504:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346772224 00000100:00100000:1.0:1787574409.994517:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574409.994523:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346771712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994552:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346771712:12345-0@lo:400:kworker.0 Request processed in 29us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.994557:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574409.994574:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787574409.994579:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346772224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994606:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346772224:12345-0@lo:400:kworker.0 Request processed in 27us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.994610:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787574409.994627:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346771072 00000100:00100000:1.0:1787574409.994630:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346771072 00000100:00100000:1.0:1787574409.994647:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346771584 00000100:00100000:1.0:1787574409.994650:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346771584 00000100:00100000:1.0:1787574409.994663:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346772096 00000100:00100000:1.0:1787574409.994665:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346772096 00000100:00100000:1.0:1787574409.994677:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787574409.994682:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346771072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994711:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346771072:12345-0@lo:400:kworker.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.994717:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787574409.994727:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787574409.994733:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346771584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994757:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346771584:12345-0@lo:400:kworker.0 Request processed in 25us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.994763:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787574409.994774:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787574409.994779:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346772096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994805:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346772096:12345-0@lo:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574409.994811:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1787574409.994832:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574409.994840:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574409.994877:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346771200:0@lo:400:kworker.0 00010000:00080000:1.0:1787574409.994890:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf4b800 x1874407346771712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574409.994899:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346771712:0@lo:400:kworker.0 00010000:00080000:1.0:1787574409.994907:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4019ec380 x1874407346772224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574409.994915:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346772224:0@lo:400:kworker.0 00000100:00100000:1.0:1787574409.994923:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346771072:0@lo:400:kworker.0 00010000:00080000:1.0:1787574409.994932:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf48a80 x1874407346771584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574409.994938:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346771584:0@lo:400:kworker.0 00010000:00080000:1.0:1787574409.994946:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4019ec000 x1874407346772096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574409.994953:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346772096:0@lo:400:kworker.0 00000100:00100000:3.0:1787574409.999296:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574409.999345:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574409.999371:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574409.999396:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574409.999418:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574409.999435:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574409.999458:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574409.999485:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323616896 00000100:00100000:3.0:1787574409.999494:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323616896 00000100:00100000:3.0:1787574409.999559:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323616768 00000100:00100000:3.0:1787574409.999562:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323616768 00000100:00100000:3.0:1787574409.999587:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:3.0:1787574409.999596:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323616896:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574409.999664:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323616896:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 69us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574409.999671:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:3.0:1787574409.999688:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:3.0:1787574409.999694:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323616768:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574409.999722:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323616768:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574409.999742:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:3.0:1787574409.999860:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323616384 00000100:00100000:3.0:1787574409.999890:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323616384 00000100:00100000:3.0:1787574409.999918:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323616640 00000100:00100000:3.0:1787574409.999921:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323616640 00000100:00100000:3.0:1787574409.999934:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323616256 00000100:00100000:3.0:1787574409.999936:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323616256 00000100:00100000:3.0:1787574409.999947:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323616512 00000100:00100000:3.0:1787574409.999949:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323616512 00000100:00100000:3.0:1787574409.999963:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:3.0:1787574409.999969:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323616384:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574410.000003:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323616384:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 35us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574410.000009:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:3.0:1787574410.000020:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 200 00000100:00100000:3.0:1787574410.000026:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323616640:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574410.000061:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323616640:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 35us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574410.000067:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 200 00000100:00100000:3.0:1787574410.000078:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 201 00000100:00100000:3.0:1787574410.000084:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323616256:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574410.000106:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323616256:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574410.000111:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 201 00000100:00100000:3.0:1787574410.000122:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 202 00000100:00100000:3.0:1787574410.000135:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323616512:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574410.000158:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323616512:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574410.000164:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 202 00000100:00080000:3.0:1787574410.000264:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574410.000269:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574410.000272:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574410.000274:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574410.000411:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323616128 00000100:00100000:2.0:1787574410.000416:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323616128 00000100:00100000:2.0:1787574410.000452:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 317 00000100:00100000:2.0:1787574410.000460:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323616128:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574410.000492:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323616128:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574410.000498:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 317 00010000:00010000:0.0:1787574410.941441:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574411.954485:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787574412.409044:0:12598:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574412.409476:0:12598:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574412.983077:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574413.046613:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346772352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574413.046689:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574413.049950:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346772352 00000100:00100000:3.0:1787574413.049968:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346772352 00000100:00100000:3.0:1787574413.050070:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787574413.050085:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346772352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574413.050120:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574413.050206:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346772352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (3516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574413.050213:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1787574413.050453:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574413.050494:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5045a9c00 x1874407346772352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574413.050514:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346772352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574413.050533:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574413.050542:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346772480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574413.050578:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574413.050665:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346772480 00000100:00100000:1.0:1787574413.050670:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346772480 00000100:00100000:1.0:1787574413.050706:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787574413.050712:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346772480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574413.050722:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574413.050753:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346772480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574413.050776:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1787574413.050972:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574413.050990:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf48a80 x1874407346772480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574413.051004:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346772480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574414.002440:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574414.585592:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346772608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574414.585722:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574414.585853:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346772608 00000100:00100000:0.0:1787574414.585862:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346772608 00000100:00100000:0.0:1787574414.585936:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787574414.585948:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346772608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574414.585985:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574414.586035:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346772608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574414.586042:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787574414.586522:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346772608:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1787574414.901563:0:12696:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574414.901772:0:12696:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574415.026407:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574415.090577:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346773120:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.090664:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.090719:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346773632:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.090745:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.090768:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346774144:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.090789:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.090897:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787574415.090906:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346772736:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.090935:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.090956:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346773248:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.090993:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.091008:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346773760:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091027:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.091040:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346774272:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091056:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.091080:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346772864:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091102:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.091116:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346773376:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091134:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.091147:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346773888:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091164:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.091180:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787574415.091186:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346772992:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091220:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.091266:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346773504:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091289:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.091307:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346774016:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091326:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.091353:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346773120 00000100:00100000:3.0:1787574415.091360:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346773120 00000100:00100000:3.0:1787574415.091402:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346772864 00000100:00100000:3.0:1787574415.091412:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346772864 00000100:00100000:3.0:1787574415.091425:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346773376 00000100:00100000:3.0:1787574415.091428:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346773376 00000100:00100000:3.0:1787574415.091449:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346773888 00000100:00100000:3.0:1787574415.091452:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346773888 00000100:00100000:3.0:1787574415.091461:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346773504 00000100:00100000:3.0:1787574415.091462:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346773504 00000100:00100000:3.0:1787574415.091472:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346774016 00000100:00100000:3.0:1787574415.091474:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346774016 00000100:00100000:3.0:1787574415.091488:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787574415.091496:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346773120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091550:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346773120:12345-0@lo:400:kworker.0 Request processed in 54us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.091557:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787574415.091573:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787574415.091579:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346772864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091610:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346772864:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.091616:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787574415.091628:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787574415.091634:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346773376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091661:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346773376:12345-0@lo:400:kworker.0 Request processed in 28us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.091666:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787574415.091677:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787574415.091682:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346773888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091706:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346773888:12345-0@lo:400:kworker.0 Request processed in 24us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.091721:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787574415.091733:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787574415.091740:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346773504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091770:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346773504:12345-0@lo:400:kworker.0 Request processed in 31us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.091776:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787574415.091786:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787574415.091793:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346774016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091835:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346774016:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.091841:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787574415.091858:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346773632 00000100:00100000:3.0:1787574415.091862:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346773632 00000100:00100000:3.0:1787574415.091880:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346774144 00000100:00100000:3.0:1787574415.091883:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346774144 00000100:00100000:3.0:1787574415.091894:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346773760 00000100:00100000:3.0:1787574415.091896:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346773760 00000100:00100000:3.0:1787574415.091905:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346774272 00000100:00100000:3.0:1787574415.091907:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346774272 00000100:00100000:3.0:1787574415.091918:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787574415.091923:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346773632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.091956:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346773632:12345-0@lo:400:kworker.0 Request processed in 33us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.091963:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787574415.091975:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787574415.091981:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346774144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092022:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346774144:12345-0@lo:400:kworker.0 Request processed in 41us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.092029:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787574415.092039:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787574415.092046:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346773760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092071:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346773760:12345-0@lo:400:kworker.0 Request processed in 26us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.092077:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787574415.092087:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787574415.092093:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346774272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092117:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346774272:12345-0@lo:400:kworker.0 Request processed in 25us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.092123:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787574415.092146:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346772736 00000100:00100000:3.0:1787574415.092150:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346772736 00000100:00100000:3.0:1787574415.092178:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787574415.092184:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346772736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092213:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346772736:12345-0@lo:400:kworker.0 Request processed in 29us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.092219:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787574415.092270:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346773248 00000100:00100000:3.0:1787574415.092275:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346773248 00000100:00100000:3.0:1787574415.092297:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346772992 00000100:00100000:3.0:1787574415.092300:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346772992 00000100:00100000:3.0:1787574415.092312:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787574415.092319:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346773248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092361:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346773248:12345-0@lo:400:kworker.0 Request processed in 42us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.092367:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787574415.092380:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787574415.092386:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346772992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092412:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346772992:12345-0@lo:400:kworker.0 Request processed in 27us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.092418:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1787574415.092456:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574415.092461:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574415.092465:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574415.092468:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574415.092494:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346772736:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092507:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346773248:0@lo:400:kworker.0 00010000:00080000:3.0:1787574415.092520:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504591f80 x1874407346773760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574415.092531:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346773760:0@lo:400:kworker.0 00010000:00080000:3.0:1787574415.092542:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d45180 x1874407346774272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574415.092550:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346774272:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092560:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346773120:0@lo:400:kworker.0 00010000:00080000:3.0:1787574415.092569:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504593100 x1874407346773632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574415.092577:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346773632:0@lo:400:kworker.0 00010000:00080000:3.0:1787574415.092593:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d47100 x1874407346774144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574415.092600:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346774144:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092637:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346772992:0@lo:400:kworker.0 00010000:00080000:3.0:1787574415.092646:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504593b80 x1874407346773504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574415.092654:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346773504:0@lo:400:kworker.0 00010000:00080000:3.0:1787574415.092662:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d44e00 x1874407346774016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574415.092670:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346774016:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092678:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346772864:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092686:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346773376:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.092694:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346773888:0@lo:400:kworker.0 00000100:00100000:3.0:1787574415.093230:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574415.093315:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346774400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574415.093376:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.093411:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346774400 00000100:00100000:3.0:1787574415.093416:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346774400 00000100:00100000:3.0:1787574415.093447:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787574415.093454:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346774400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574415.093479:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574415.093516:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346774400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.093533:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:3.0:1787574415.093564:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40351ca80 x1874407346774400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574415.093579:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40351ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346774400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574415.094044:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574415.094055:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346774528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574415.094086:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.094178:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346774528 00000100:00100000:3.0:1787574415.094183:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346774528 00000100:00100000:3.0:1787574415.094264:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787574415.094272:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346774528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574415.094296:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574415.094333:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346774528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.094340:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787574415.094498:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574415.094507:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346774656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574415.094536:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574415.096659:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346774528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574415.096704:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346774656 00000100:00100000:3.0:1787574415.096709:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346774656 00000100:00100000:3.0:1787574415.096751:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787574415.096760:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346774656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574415.096782:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574415.096975:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346774656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 216us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.096983:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1787574415.097023:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366ce00 x1874407346774656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574415.097037:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346774656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574415.116335:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574415.116389:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574415.116413:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574415.116434:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574415.116469:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574415.116491:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574415.116516:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574415.116543:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323617280 00000100:00100000:3.0:1787574415.116552:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323617280 00000100:00100000:3.0:1787574415.116610:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323617536 00000100:00100000:3.0:1787574415.116613:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323617536 00000100:00100000:3.0:1787574415.116628:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323617152 00000100:00100000:3.0:1787574415.116631:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323617152 00000100:00100000:3.0:1787574415.116642:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323617408 00000100:00100000:3.0:1787574415.116644:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323617408 00000100:00100000:3.0:1787574415.116658:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 209 00000100:00100000:3.0:1787574415.116667:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323617280:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574415.116742:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323617280:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 75us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.116750:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 209 00000100:00100000:3.0:1787574415.116766:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 210 00000100:00100000:3.0:1787574415.116773:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323617536:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574415.116800:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323617536:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.116806:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 210 00000100:00100000:3.0:1787574415.116831:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 211 00000100:00100000:3.0:1787574415.116839:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323617152:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574415.116880:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323617152:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.116887:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 211 00000100:00100000:3.0:1787574415.116899:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 212 00000100:00100000:3.0:1787574415.116906:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323617408:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574415.116926:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323617408:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.116932:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 212 00000100:00100000:3.0:1787574415.116956:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323617664 00000100:00100000:3.0:1787574415.116960:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323617664 00000100:00100000:3.0:1787574415.116986:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323617792 00000100:00100000:3.0:1787574415.116989:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323617792 00000100:00100000:3.0:1787574415.117011:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1787574415.117018:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2401:x1874407323617664:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:3.0:1787574415.117037:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7fd7 00000100:00080000:3.0:1787574415.117046:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9ca53bf12800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574415.117093:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787574415.117214:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0874c266-15f3-4d8d-abed-9d908d92af46+2:2401:x1874407323617664:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 196us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.117222:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1787574415.117235:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1787574415.117267:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2401:x1874407323617792:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:3.0:1787574415.117280:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7fde 00000100:00080000:3.0:1787574415.117285:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9ca4035e1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574415.117310:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787574415.117388:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0874c266-15f3-4d8d-abed-9d908d92af46+2:2401:x1874407323617792:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 121us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574415.117395:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00080000:3.0:1787574415.117415:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574415.117419:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574415.117422:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574415.117424:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787574415.117565:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574415.117572:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574415.118065:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323617024 00000100:00100000:1.0:1787574415.118071:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323617024 00000100:00100000:1.0:1787574415.118115:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 319 00000100:00100000:1.0:1787574415.118123:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323617024:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574415.118166:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323617024:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 44us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574415.118172:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 319 00010000:00010000:1.0:1787574416.051628:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574417.075910:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787574417.214029:0:12794:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574417.214328:0:12794:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574418.097699:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574418.161673:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574418.161708:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346774784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574418.161862:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574418.162036:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346774784 00000100:00100000:3.0:1787574418.162048:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346774784 00000100:00100000:3.0:1787574418.162139:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787574418.162162:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346774784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574418.162201:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574418.162293:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346774784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574418.162302:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:3.0:1787574418.162350:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504593b80 x1874407346774784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574418.162374:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346774784:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787574418.162441:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574418.162701:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574418.162714:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346774912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574418.162750:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574418.162835:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346774912 00000100:00100000:2.0:1787574418.162841:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346774912 00000100:00100000:2.0:1787574418.162894:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787574418.162903:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346774912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574418.162919:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574418.162957:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346774912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574418.162965:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1787574418.163019:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574418.163040:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf4b800 x1874407346774912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574418.163055:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346774912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574419.121466:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787574419.343768:0:12891:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574419.344054:0:12891:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787574419.697913:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574419.697936:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346775040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574419.698012:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574419.698076:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346775040 00000100:00100000:0.0:1787574419.698085:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346775040 00000100:00100000:0.0:1787574419.698135:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787574419.698144:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346775040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574419.698181:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574419.698232:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346775040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574419.698277:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787574419.698330:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346775040:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787574420.147369:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574420.210474:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346775168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574420.210544:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574420.210600:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574420.210619:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346775296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574420.210646:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574420.210682:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346775168 00000100:00100000:3.0:1787574420.210701:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346775168 00000100:00100000:3.0:1787574420.210748:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787574420.210758:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346775168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574420.210799:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574420.210873:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346775168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574420.210881:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787574420.210925:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346775168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574420.211333:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574420.211343:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346775424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574420.211379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574420.211444:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346775296 00000100:00100000:2.0:1787574420.211449:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346775296 00000100:00100000:2.0:1787574420.211483:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346775424 00000100:00100000:2.0:1787574420.211486:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346775424 00000100:00100000:2.0:1787574420.211502:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787574420.211509:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346775296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574420.211528:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574420.211562:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346775296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574420.211569:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787574420.211583:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787574420.211589:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346775424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574420.211598:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574420.211625:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346775424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574420.211630:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1787574420.211646:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787574420.211670:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366e680 x1874407346775424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574420.211698:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346775424:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787574420.211725:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504593100 x1874407346775296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574420.211737:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346775296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574420.218094:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346775808:0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.218176:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574420.218225:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346776320:0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.218382:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574420.218489:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787574420.218497:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346775680:0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.218527:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574420.218546:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346776192:0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.218566:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574420.218583:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346776704:0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.218603:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574420.218633:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346775808 00000100:00100000:0.0:1787574420.218640:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346775808 00000100:00100000:0.0:1787574420.218683:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787574420.222220:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346775808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.222357:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346775808:12345-0@lo:400:kworker.0 Request processed in 153us (4180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574420.222365:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787574420.222519:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346776320 00000100:00100000:0.0:1787574420.222527:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346776320 00000100:00100000:0.0:1787574420.222579:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787574420.222587:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346776320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.222619:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346776320:12345-0@lo:400:kworker.0 Request processed in 34us (4318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574420.222626:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787574420.222647:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346775680 00000100:00100000:0.0:1787574420.222650:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346775680 00000100:00100000:0.0:1787574420.222671:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346776192 00000100:00100000:0.0:1787574420.222674:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346776192 00000100:00100000:0.0:1787574420.222920:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346776704 00000100:00100000:0.0:1787574420.222934:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346776704 00000100:00100000:0.0:1787574420.222954:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787574420.222960:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346775680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.222995:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346775680:12345-0@lo:400:kworker.0 Request processed in 35us (4467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574420.223001:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787574420.223015:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787574420.223022:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346776192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.223048:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346776192:12345-0@lo:400:kworker.0 Request processed in 28us (4481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574420.223054:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787574420.223064:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787574420.223070:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346776704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.223097:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346776704:12345-0@lo:400:kworker.0 Request processed in 27us (4493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574420.223103:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787574420.223159:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346775680:0@lo:400:kworker.0 00010000:00080000:0.0:1787574420.223173:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5350e4a80 x1874407346776192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574420.223184:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346776192:0@lo:400:kworker.0 00010000:00080000:0.0:1787574420.223195:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5350e5180 x1874407346776704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574420.223203:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346776704:0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.223215:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346775808:0@lo:400:kworker.0 00010000:00080000:0.0:1787574420.223234:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5350e4700 x1874407346776320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574420.223263:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346776320:0@lo:400:kworker.0 00000100:00080000:0.0:1787574420.223294:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574420.223298:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574420.223323:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346775936:0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.223358:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574420.223382:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346776448:0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.224836:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346775552:0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.224894:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574420.224938:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346776064:0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.224963:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574420.224983:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346776576:0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.225004:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574420.225038:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346775552 00000100:00100000:1.0:1787574420.225044:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346775552 00000100:00100000:1.0:1787574420.225086:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787574420.225095:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346775552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.225156:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346775552:12345-0@lo:400:kworker.0 Request processed in 62us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574420.225163:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787574420.225207:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346775552:0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.225286:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346775936 00000100:00100000:1.0:1787574420.225290:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346775936 00000100:00100000:1.0:1787574420.225316:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346776064 00000100:00100000:1.0:1787574420.225319:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346776064 00000100:00100000:1.0:1787574420.225340:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346776576 00000100:00100000:1.0:1787574420.225343:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346776576 00000100:00100000:1.0:1787574420.225356:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787574420.225362:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346775936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.225394:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346775936:12345-0@lo:400:kworker.0 Request processed in 32us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574420.225401:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787574420.225412:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787574420.225435:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346776064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.225468:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346776064:12345-0@lo:400:kworker.0 Request processed in 51us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574420.225473:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787574420.225483:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787574420.225489:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346776576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.225512:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346776576:12345-0@lo:400:kworker.0 Request processed in 24us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574420.225517:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787574420.225555:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346776064:0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.225572:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346776576:0@lo:400:kworker.0 00000100:00100000:0.0:1787574420.229014:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574420.229117:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346775936:0@lo:400:kworker.0 00000100:00080000:0.0:1787574420.229173:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574420.229752:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346776448 00000100:00100000:1.0:1787574420.229761:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346776448 00000100:00100000:1.0:1787574420.229835:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787574420.229846:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346776448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.229924:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346776448:12345-0@lo:400:kworker.0 Request processed in 79us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574420.229931:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1787574420.230069:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574420.230097:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5350e6a00 x1874407346776448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574420.230110:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346776448:0@lo:400:kworker.0 00000100:00100000:1.0:1787574420.239976:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574420.240021:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574420.240042:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574420.240058:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574420.240076:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574420.240100:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323618048 00000100:00100000:1.0:1787574420.240109:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323618048 00000100:00100000:1.0:1787574420.240154:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323618176 00000100:00100000:1.0:1787574420.240156:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323618176 00000100:00100000:1.0:1787574420.240168:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323618304 00000100:00100000:1.0:1787574420.240170:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323618304 00000100:00100000:1.0:1787574420.240182:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323618432 00000100:00100000:1.0:1787574420.240184:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323618432 00000100:00100000:1.0:1787574420.240199:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 219 00000100:00100000:1.0:1787574420.240209:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323618048:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574420.240298:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323618048:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 91us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574420.240306:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 219 00000100:00100000:1.0:1787574420.240324:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 220 00000100:00100000:1.0:1787574420.240338:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323618176:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574420.240361:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323618176:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574420.240367:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 220 00000100:00100000:1.0:1787574420.240378:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 221 00000100:00100000:1.0:1787574420.240383:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323618304:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574420.240418:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323618304:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574420.240425:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 221 00000100:00100000:1.0:1787574420.240437:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 222 00000100:00100000:1.0:1787574420.240443:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323618432:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574420.240462:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323618432:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574420.240468:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 222 00000100:00080000:0.0:1787574420.240793:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574420.240797:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574420.242205:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323617920 00000100:00100000:3.0:1787574420.242217:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323617920 00000100:00100000:3.0:1787574420.242354:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 321 00000100:00100000:3.0:1787574420.242363:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2403:x1874407323617920:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574420.242437:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2403:x1874407323617920:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 75us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574420.242444:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 321 00000001:00100000:0.0:1787574420.728933:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0874c266-15f3-4d8d-abed-9d908d92af46 00000020:00000080:0.0:1787574420.728943:0:8419:0:(genops.c:885:class_export_put()) final put ffff9ca53bf11800/0874c266-15f3-4d8d-abed-9d908d92af46 00000020:00000080:3.0:1787574420.729086:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53bf11800/0874c266-15f3-4d8d-abed-9d908d92af46 for lustre-OST0000 00000020:00000080:3.0:1787574420.730658:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca53bf12800 for lustre-OST0000 00000001:00100000:3.0:1787574420.731779:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0874c266-15f3-4d8d-abed-9d908d92af46 00000020:00000080:3.0:1787574420.731787:0:9505:0:(genops.c:885:class_export_put()) final put ffff9ca53bf17000/0874c266-15f3-4d8d-abed-9d908d92af46 00000020:00000080:0.0:1787574420.732235:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53bf17000/0874c266-15f3-4d8d-abed-9d908d92af46 for lustre-OST0001 00000020:00000080:0.0:1787574420.732676:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4035e1000 for lustre-OST0001 00010000:00010000:3.0:1787574421.170892:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574422.197819:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574423.217441:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574423.281703:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574423.283203:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574423.283223:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346776960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574423.283313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574423.283854:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346776832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574423.283893:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574423.283956:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346776960 00000100:00100000:2.0:1787574423.283964:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346776960 00000100:00100000:2.0:1787574423.284009:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346776832 00000100:00100000:2.0:1787574423.284012:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346776832 00000100:00100000:2.0:1787574423.284029:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787574423.284037:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346776960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574423.284066:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574423.284110:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346776960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574423.284116:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787574423.284132:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787574423.284138:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346776832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574423.284148:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574423.284176:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346776832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574423.284182:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1787574423.284195:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574423.284222:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf48700 x1874407346776960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574423.284257:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346776960:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787574423.284289:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504593b80 x1874407346776832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574423.284302:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346776832:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1787574424.066173:0:13037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787574424.244432:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574424.817892:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574424.817933:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346777088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574424.818558:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574424.819990:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346777088 00000100:00100000:0.0:1787574424.820014:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346777088 00000100:00100000:0.0:1787574424.820133:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787574424.820156:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346777088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574424.820192:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574424.820287:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346777088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574424.820294:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787574424.820381:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346777088:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787574425.265486:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574425.329433:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346777216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574425.329513:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574425.329689:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346777216 00000100:00100000:3.0:1787574425.329698:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346777216 00000100:00100000:3.0:1787574425.329767:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787574425.329777:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346777216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574425.329809:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574425.329858:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346777216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574425.329865:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787574425.329906:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346777216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574425.330465:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574425.330478:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346777472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574425.330522:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574425.330561:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346777472 00000100:00100000:3.0:1787574425.330567:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346777472 00000100:00100000:3.0:1787574425.330607:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787574425.330615:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346777472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574425.330637:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574425.330674:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346777472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574425.330680:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1787574425.330698:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574425.330709:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574425.330744:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346777344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574425.330773:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574425.330802:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346777344 00000100:00100000:3.0:1787574425.330806:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346777344 00000100:00100000:3.0:1787574425.330833:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787574425.330840:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346777344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574425.330850:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574425.330878:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346777344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574425.330884:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787574425.330897:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787574425.330920:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504593b80 x1874407346777472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574425.330935:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346777472:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787574425.330958:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366df80 x1874407346777344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574425.330968:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346777344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574425.334811:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574425.334837:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346777600:0@lo:400:kworker.0 00000100:00100000:1.0:1787574425.334863:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346777856:0@lo:400:kworker.0 00000100:00100000:0.0:1787574425.335989:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346777728:0@lo:400:kworker.0 00000100:00100000:2.0:1787574425.336089:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574425.336158:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346777984:0@lo:400:kworker.0 00000100:00100000:2.0:1787574425.336189:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574425.336210:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346778496:0@lo:400:kworker.0 00000100:00100000:3.0:1787574425.336335:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346777600 00000100:00100000:3.0:1787574425.336343:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346777600 00000100:00100000:3.0:1787574425.336390:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787574425.336400:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346777600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574425.336450:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346777600:12345-0@lo:400:kworker.0 Request processed in 51us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574425.336457:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787574425.336547:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574425.336589:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346777600:0@lo:400:kworker.0 00000100:00100000:2.0:1787574425.336609:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787574425.336615:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346778112:0@lo:400:kworker.0 00000100:00100000:2.0:1787574425.336639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574425.336659:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346778624:0@lo:400:kworker.0 00000100:00100000:2.0:1787574425.336679:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574425.336705:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346777984 00000100:00100000:2.0:1787574425.336709:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346777984 00000100:00100000:3.0:1787574425.336818:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346778496 00000100:00100000:3.0:1787574425.336823:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346778496 00000100:00100000:2.0:1787574425.336891:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346778112 00000100:00100000:2.0:1787574425.336895:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346778112 00000100:00100000:1.0:1787574425.336959:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574425.336982:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346778368:0@lo:400:kworker.0 00000100:00100000:1.0:1787574425.337010:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574425.337042:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346778368 00000100:00100000:1.0:1787574425.337046:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346778368 00000100:00100000:3.0:1787574425.337058:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346778624 00000100:00100000:3.0:1787574425.337061:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346778624 00000100:00100000:3.0:1787574425.337072:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346777856 00000100:00100000:1.0:1787574425.337072:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787574425.337075:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346777856 00000100:00100000:3.0:1787574425.337085:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787574425.337086:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346778368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574425.337090:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346777984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574425.337123:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346777984:12345-0@lo:400:kworker.0 Request processed in 32us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574425.337123:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346778368:12345-0@lo:400:kworker.0 Request processed in 38us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574425.337130:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787574425.337130:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787574425.337144:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787574425.337150:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346778496:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787574425.337162:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403487480 x1874407346778368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574425.337173:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346778368:0@lo:400:kworker.0 00000100:00100000:3.0:1787574425.337175:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346778496:12345-0@lo:400:kworker.0 Request processed in 26us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574425.337180:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787574425.337191:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787574425.337197:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346778624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574425.337489:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346778624:12345-0@lo:400:kworker.0 Request processed in 290us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574425.337496:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787574425.337510:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787574425.337516:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346777856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574425.337548:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346777856:12345-0@lo:400:kworker.0 Request processed in 33us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574425.337554:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787574425.337652:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787574425.337660:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346778112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574425.337694:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346778112:12345-0@lo:400:kworker.0 Request processed in 36us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574425.337700:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00080000:2.0:1787574425.338382:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403485880 x1874407346778112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574425.338396:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346778112:0@lo:400:kworker.0 00010000:00080000:2.0:1787574425.338423:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca50459b480 x1874407346778624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574425.338431:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346778624:0@lo:400:kworker.0 00000100:00100000:2.0:1787574425.338443:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346777984:0@lo:400:kworker.0 00000100:00100000:1.0:1787574425.338622:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346777856:0@lo:400:kworker.0 00000100:00100000:2.0:1787574425.338638:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346778496:0@lo:400:kworker.0 00000100:00080000:2.0:1787574425.338666:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574425.338672:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574425.338674:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574425.339020:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574425.339088:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346778240:0@lo:400:kworker.0 00000100:00100000:1.0:1787574425.339119:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574425.339195:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346778240 00000100:00100000:3.0:1787574425.339203:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346778240 00000100:00080000:0.0:1787574425.339309:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574425.339368:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787574425.339386:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346778240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574425.339743:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346778240:12345-0@lo:400:kworker.0 Request processed in 358us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574425.339751:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:0.0:1787574425.339935:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403486d80 x1874407346778240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574425.339946:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346778240:0@lo:400:kworker.0 00000100:00100000:2.0:1787574425.340011:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346777728 00000100:00100000:2.0:1787574425.340016:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346777728 00000100:00100000:2.0:1787574425.340084:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787574425.340092:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346777728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574425.340161:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346777728:12345-0@lo:400:kworker.0 Request processed in 69us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574425.340168:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787574425.340225:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346777728:0@lo:400:kworker.0 00000100:00100000:1.0:1787574425.352376:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574425.352457:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574425.352487:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574425.352523:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574425.352551:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574425.352582:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323618816 00000100:00100000:1.0:1787574425.352593:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323618816 00000100:00100000:1.0:1787574425.352655:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323619072 00000100:00100000:1.0:1787574425.352659:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323619072 00000100:00100000:1.0:1787574425.352673:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323618688 00000100:00100000:1.0:1787574425.352675:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323618688 00000100:00100000:1.0:1787574425.352686:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323618944 00000100:00100000:1.0:1787574425.352688:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323618944 00000100:00100000:1.0:1787574425.352703:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 229 00000100:00100000:1.0:1787574425.352712:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323618816:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574425.352827:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 230 00000100:00100000:2.0:1787574425.352837:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323619072:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574425.352922:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323619072:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 87us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574425.352931:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 230 00000100:00100000:2.0:1787574425.352953:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 231 00000100:00100000:2.0:1787574425.352959:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323618688:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574425.352986:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323618688:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574425.353007:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 231 00000100:00100000:2.0:1787574425.353021:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 232 00000100:00100000:2.0:1787574425.353027:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323618944:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574425.353052:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323618944:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574425.353057:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 232 00000100:00100000:1.0:1787574425.353306:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323618816:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 593us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574425.353313:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 229 00000100:00080000:1.0:1787574425.353445:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574425.353450:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574425.353595:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323618560 00000100:00100000:3.0:1787574425.353602:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323618560 00000100:00100000:3.0:1787574425.353643:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 323 00000100:00100000:3.0:1787574425.353650:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2402:x1874407323618560:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574425.353817:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2402:x1874407323618560:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 166us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574425.353824:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 323 00010000:00010000:0.0:1787574426.289473:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574427.314500:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787574428.254454:0:13184:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc1e3a600 20000000:00000080:1.0:1787574428.254472:0:13184:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ca53f47e400 uarg=0000000000000000 20000000:01000000:1.0:1787574428.254512:0:13184:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787574428.254518:0:13184:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787574428.254521:0:13184:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787574428.255037:0:13185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787574428.255186:0:13184:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787574428.266064:0:13184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787574428.268951:0:13184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.268977:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb7f7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f75 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.268987:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be98800/0xd18a1efeeddb7f8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f83 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.268994:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7f98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f91 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.269001:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7fa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7f9f expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.269011:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b57f expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.269036:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7fc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5be expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.269044:0:13184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.269087:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5be expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.269103:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7fc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5be expref: 12 pid: 6504 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574428.269119:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403597b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346778752:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574428.269296:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b57f expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.269304:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7fad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b57f expref: 12 pid: 6504 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574428.269313:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403597800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346778880:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574428.269346:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7f9f expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.269355:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7fa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f9f expref: 23 pid: 6501 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574428.269364:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403596680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346779008:0@lo:104: 00000100:00100000:0.0:1787574428.269401:0:13184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574428.269448:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7f98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7f91 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.269457:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7f98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f91 expref: 23 pid: 6503 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574428.269465:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346779136:0@lo:104: 00000100:00100000:0.0:1787574428.269487:0:13184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574428.269514:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be98800/0xd18a1efeeddb7f8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7f83 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.269522:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be98800/0xd18a1efeeddb7f8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f83 expref: 23 pid: 6501 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574428.269530:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403596a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346779264:0@lo:104: 00000100:00100000:0.0:1787574428.269551:0:13184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574428.269568:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb7f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7f75 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.269575:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb7f7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f75 expref: 23 pid: 6503 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574428.269583:0:13184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346779392:0@lo:104: 00000100:00100000:0.0:1787574428.269601:0:13184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574428.269610:0:13184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca508f8a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787574428.270275:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346779008 00000100:00100000:2.0:1787574428.270284:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346779008 00000100:00100000:2.0:1787574428.270320:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346779136 00000100:00100000:2.0:1787574428.270322:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346779136 00000100:00100000:2.0:1787574428.270330:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346779264 00000100:00100000:2.0:1787574428.270332:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346779264 00000100:00100000:2.0:1787574428.270338:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346779392 00000100:00100000:2.0:1787574428.270341:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346779392 00000100:00100000:2.0:1787574428.270352:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787574428.270360:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+6:13184:x1874407346779008:12345-0@lo:104: 00010000:00010000:2.0:1787574428.270373:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270431:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787574428.270436:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+6:13184:x1874407346779008:12345-0@lo:104: Request processed in 77us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574428.270443:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787574428.270459:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787574428.270465:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403594380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:13184:x1874407346779136:12345-0@lo:104: 00010000:00010000:2.0:1787574428.270471:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270510:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787574428.270515:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403594380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:13184:x1874407346779136:12345-0@lo:104: Request processed in 51us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574428.270521:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787574428.270534:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574428.270540:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403595c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:13184:x1874407346779264:12345-0@lo:104: 00010000:00010000:2.0:1787574428.270546:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270570:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787574428.270574:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403595c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:13184:x1874407346779264:12345-0@lo:104: Request processed in 36us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574428.270580:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574428.270590:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787574428.270595:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:13184:x1874407346779392:12345-0@lo:104: 00010000:00010000:2.0:1787574428.270601:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270622:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787574428.270626:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:13184:x1874407346779392:12345-0@lo:104: Request processed in 32us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574428.270631:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787574428.270727:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787574428.270733:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270752:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be98c00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574428.270757:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270765:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574428.270772:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574428.270777:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787574428.270810:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270817:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574428.270835:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270843:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be98c00/0xd18a1efeeddb7f9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7fa6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270854:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787574428.270857:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270863:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574428.270865:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270883:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574428.270889:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574428.270894:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787574428.270921:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270927:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574428.270933:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270940:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be99a00/0xd18a1efeeddb7f91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7f98 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270948:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574428.270951:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270956:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574428.270959:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.270965:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574428.270970:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574428.270981:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787574428.270998:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271003:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574428.271017:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271023:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c10000/0xd18a1efeeddb7f83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7f8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271031:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574428.271034:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271039:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574428.271041:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271047:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574428.271053:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574428.271059:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787574428.271070:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271075:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574428.271088:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271094:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c11a00/0xd18a1efeeddb7f75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7f7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271107:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574428.271109:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574428.271110:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574428.271117:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574428.271130:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346779520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574428.271165:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574428.271197:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574428.271202:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346779648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574428.271222:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574428.271268:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346779776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574428.271289:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574428.271311:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574428.271315:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346779904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574428.271334:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574428.271361:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346779520 00000100:00100000:2.0:1787574428.271365:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346779520 00010000:00010000:2.0:1787574428.271385:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7fa6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f9f expref: 24 pid: 6501 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574428.271398:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346779648 00000100:00100000:2.0:1787574428.271401:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346779648 00010000:00010000:2.0:1787574428.271409:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7f98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f91 expref: 25 pid: 6503 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574428.271429:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346779776 00000100:00100000:2.0:1787574428.271431:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346779776 00010000:00010000:2.0:1787574428.271440:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be98800/0xd18a1efeeddb7f8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f83 expref: 26 pid: 6501 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574428.271448:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346779904 00000100:00100000:2.0:1787574428.271450:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346779904 00010000:00010000:2.0:1787574428.271458:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb7f7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f75 expref: 27 pid: 6503 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574428.271469:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787574428.271476:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+27:3634:x1874407346779520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574428.271486:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574428.271491:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7fa6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f9f expref: 27 pid: 6501 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271500:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7fa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f9f expref: 27 pid: 6501 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271514:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574428.271543:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+27:3634:x1874407346779520:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574428.271549:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787574428.271561:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574428.271567:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+26:3634:x1874407346779648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574428.271573:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574428.271577:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7f98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f91 expref: 26 pid: 6503 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271597:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7f98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f91 expref: 26 pid: 6503 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.271605:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574428.271627:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+26:3634:x1874407346779648:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574428.271632:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574428.272500:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787574428.272514:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+25:3636:x1874407346779776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574428.272525:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574428.272531:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be98800/0xd18a1efeeddb7f8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f83 expref: 25 pid: 6501 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.272540:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be98800/0xd18a1efeeddb7f8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f83 expref: 25 pid: 6501 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.272553:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574428.272591:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+25:3636:x1874407346779776:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1300us total) trans 0 rc 0/0 00010000:00010000:0.0:1787574428.272697:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb7fa6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7f9f expref: 25 pid: 6501 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574428.272720:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403596680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346779008:0@lo:104: 00010000:00010000:0.0:1787574428.272734:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb7f98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7f91 expref: 24 pid: 6503 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574428.272752:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346779136:0@lo:104: 00010000:00010000:0.0:1787574428.272765:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be98800/0xd18a1efeeddb7f8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7f83 expref: 23 pid: 6501 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574428.272773:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403596a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346779264:0@lo:104: 00000100:00100000:0.0:1787574428.272782:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346779392:0@lo:104: 00000100:00100000:3.0:1787574428.277633:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574428.278318:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403597b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346778752:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574428.278331:0:13184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403597800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1874407346778880:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574428.278384:0:13184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574428.278848:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3636:x1874407346779904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574428.278868:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574428.278876:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb7f7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f75 expref: 22 pid: 6503 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.278888:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb7f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7f75 expref: 22 pid: 6503 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.278906:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb7f7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7f75 expref: 22 pid: 6503 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.278920:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574428.278972:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3636:x1874407346779904:12345-0@lo:103:ldlm_bl.0 Request processed in 1325us (7635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574428.278999:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787574428.279093:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787574428.279150:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346779904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574428.279161:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346779776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574428.279192:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346779648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574428.279201:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346779520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574428.285065:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574428.285211:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574428.285962:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323619200 00000100:00100000:3.0:1787574428.285973:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323619200 00010000:00010000:3.0:1787574428.286016:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7fc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5be expref: 13 pid: 6504 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574428.286056:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323619328 00000100:00100000:3.0:1787574428.286060:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323619328 00010000:00010000:3.0:1787574428.286073:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7fad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b57f expref: 14 pid: 6504 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574428.286103:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:3.0:1787574428.286114:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+14:2404:x1874407323619200:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574428.286128:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574428.286133:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7fc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5be expref: 14 pid: 6504 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286146:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5be expref: 14 pid: 6504 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286164:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7fc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5be expref: 14 pid: 6504 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286180:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574428.286232:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323619200:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 120us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574428.286271:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:3.0:1787574428.286291:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1787574428.286313:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b688850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:2404:x1874407323619328:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574428.286321:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574428.286325:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7fad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b57f expref: 12 pid: 6504 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286334:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b57f expref: 12 pid: 6504 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286359:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb7fad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b57f expref: 12 pid: 6504 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286370:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286379:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286394:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286400:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286407:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286414:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286420:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574428.286425:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286438:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286451:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574428.286461:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574428.286481:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b688850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:2404:x1874407323619328:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 170us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574428.286487:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00010000:00010000:0.0:1787574428.286583:0:13184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.286591:0:13184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574428.286597:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c11600/0xd18a1efeeddb7fe5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574428.353922:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574428.411669:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346780032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574428.411747:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574428.411970:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346780032 00000100:00100000:3.0:1787574428.411978:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346780032 00000100:00100000:3.0:1787574428.412031:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787574428.412042:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346780032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574428.412071:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574428.412116:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346780032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574428.412123:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:3.0:1787574428.412162:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d52300 x1874407346780032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574428.412180:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346780032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574428.412196:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574428.412202:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346780160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574428.412227:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787574428.412285:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574428.412296:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346780160 00000100:00100000:3.0:1787574428.412309:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346780160 00000100:00100000:3.0:1787574428.412336:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787574428.412343:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346780160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574428.412353:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574428.412385:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346780160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574428.412392:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1787574428.412410:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787574428.412431:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5045ab100 x1874407346780160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574428.412443:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346780160:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787574429.361531:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787574429.425474:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574429.425485:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53bf11000 from 7 10000000:01000000:0.0:1787574429.425493:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574429.425682:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574429.425758:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574429.425772:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574429.425817:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574429.425917:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574429.426020:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca508f8a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574429.431275:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346780288 00000100:00100000:3.0:1787574429.431297:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346780288 00000100:00100000:3.0:1787574429.431410:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787574429.431425:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346780288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574429.431459:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574429.431486:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7ff3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7fec expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.431883:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7ff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7fec expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.431899:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7ff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7fec expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.431912:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030800, rc 0) 00000100:00100000:3.0:1787574429.432030:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346780288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 608us (6112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574429.432058:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787574429.433171:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574429.433203:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574429.433218:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574429.433365:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574429.433439:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574429.433482:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca508f8a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574429.434670:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346780416 00000100:00100000:3.0:1787574429.434683:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346780416 00000100:00100000:3.0:1787574429.434760:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787574429.434771:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346780416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574429.436224:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346780416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1447us (2778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574429.436254:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787574429.438290:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574429.438838:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574429.438937:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574429.438992:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca508f8a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574429.439927:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346780544 00000100:00100000:3.0:1787574429.439944:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346780544 00000100:00100000:3.0:1787574429.440023:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787574429.440046:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346780544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574429.440275:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346780544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574429.440284:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787574429.441532:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787574429.444185:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787574429.445213:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787574429.445270:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574429.445285:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.445300:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574429.445313:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787574429.445316:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53bc3a000 from 7 10000000:01000000:3.0:1787574429.445319:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574429.445382:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.445398:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.445412:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574429.445444:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574429.445737:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574429.445789:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40237d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574429.447452:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346780672 00000100:00100000:0.0:1787574429.447470:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346780672 00000100:00100000:0.0:1787574429.447745:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787574429.447759:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346780672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574429.447782:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574429.447803:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb8001 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb7ffa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574429.447839:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb8001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb7ffa expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574429.447853:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb8001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7ffa expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574429.447865:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10200, rc 0) 00000100:00100000:0.0:1787574429.447956:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346780672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574429.447964:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787574429.448081:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574429.448105:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574429.448125:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574429.448222:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574429.448280:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574429.449932:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebe540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574429.450044:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346780800 00000100:00100000:3.0:1787574429.450055:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346780800 00000100:00100000:3.0:1787574429.450128:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787574429.450140:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346780800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574429.450344:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346780800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574429.450359:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787574429.450457:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574429.450518:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574429.450572:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574429.450599:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebe540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574429.450715:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346780928 00000100:00100000:3.0:1787574429.450719:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346780928 00000100:00100000:3.0:1787574429.450738:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1787574429.450744:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346780928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574429.450831:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346780928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574429.450838:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787574429.450912:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346780928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787574429.452115:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787574429.452528:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787574429.452554:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574429.452567:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.452594:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574429.452618:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787574429.452622:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca526758000 from 7 10000000:01000000:3.0:1787574429.452625:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574429.452662:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.452671:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.452682:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574429.452717:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574429.452775:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574429.452820:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40237d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574429.453080:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346781056 00000100:00100000:1.0:1787574429.453087:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346781056 00000100:00100000:1.0:1787574429.453131:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787574429.453140:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346781056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574429.453154:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574429.453167:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb800f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb8008 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574429.453193:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb800f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb8008 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574429.453204:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb800f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb8008 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574429.453214:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75200, rc 0) 00000100:00100000:1.0:1787574429.453284:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346781056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574429.453291:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787574429.453554:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574429.453571:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.453582:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574429.453658:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574429.453697:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574429.453730:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40237d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574429.453862:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346781184 00000100:00100000:1.0:1787574429.453868:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346781184 00000100:00100000:1.0:1787574429.453887:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787574429.453894:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346781184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574429.454016:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346781184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574429.454023:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787574429.455745:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574429.455818:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574429.455895:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574429.455936:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40237d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574429.456623:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346781312 00000100:00100000:1.0:1787574429.456645:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346781312 00000100:00100000:1.0:1787574429.456719:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787574429.456730:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346781312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574429.456862:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346781312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574429.456870:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787574429.457026:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787574429.462067:0:13206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787574429.463744:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787574429.463775:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574429.463791:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.463805:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574429.463819:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787574429.463822:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca5109bd800 from 7 10000000:01000000:3.0:1787574429.463825:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574429.463881:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.463889:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574429.463903:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574429.463938:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574429.464027:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574429.464140:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40237d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574429.467575:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346781440 00000100:00100000:1.0:1787574429.467594:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346781440 00000100:00100000:1.0:1787574429.467708:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787574429.467721:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346781440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574429.467744:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574429.467769:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be75c00/0xd18a1efeeddb801d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb8016 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574429.467808:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be75c00/0xd18a1efeeddb801d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb8016 expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574429.467821:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be75c00/0xd18a1efeeddb801d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb8016 expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574429.467834:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75c00, rc 0) 00000100:00100000:1.0:1787574429.467938:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346781440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (3909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574429.467945:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1787574429.470388:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574429.470428:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574429.470445:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574429.470573:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574429.470655:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574429.470717:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574429.470964:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346781568 00000100:00100000:1.0:1787574429.470973:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346781568 00000100:00100000:1.0:1787574429.471032:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787574429.471042:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346781568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574429.471214:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346781568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574429.471222:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787574429.471497:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574429.471593:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574429.471707:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574429.471730:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574429.471773:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346781696 00000100:00100000:1.0:1787574429.471778:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346781696 00000100:00100000:1.0:1787574429.471808:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787574429.471814:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346781696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574429.471893:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346781696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574429.471900:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787574429.471970:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346781696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787574429.475876:0:13207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787574429.482502:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787574429.482562:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574429.482578:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574429.482595:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574429.955800:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346781824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574429.955903:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574429.959293:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346781824 00000100:00100000:0.0:1787574429.959317:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346781824 00000100:00100000:0.0:1787574429.959407:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787574429.959420:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346781824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574429.959470:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574429.974722:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346781824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 15288us (18802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574429.974821:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787574430.000902:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346781824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574430.154072:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574430.157830:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323619456 00000100:00100000:3.0:1787574430.157850:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323619456 00000100:00100000:3.0:1787574430.157950:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 336 00000100:00100000:3.0:1787574430.157963:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:6179:x1874407323619456:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574430.157986:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574430.158011:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb8024 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b5ef expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574430.158047:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb8024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5ef expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574430.158059:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb8024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5ef expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574430.158070:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031600, rc 0) 00000100:00100000:3.0:1787574430.158148:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323619456:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 188us (4095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574430.158156:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 336 00000100:00100000:2.0:1787574430.162433:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574430.172726:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323619584 00000100:00100000:0.0:1787574430.172770:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323619584 00000100:00100000:0.0:1787574430.172861:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 337 00000100:00100000:0.0:1787574430.172873:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323619584:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574430.173092:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323619584:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 220us (10674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.173102:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 337 00000100:00100000:0.0:1787574430.178939:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574430.182997:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323619712 00000100:00100000:2.0:1787574430.183020:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323619712 00000100:00100000:3.0:1787574430.183169:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 338 00000100:00100000:3.0:1787574430.183183:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323619712:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574430.183400:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323619712:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 219us (4475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574430.183409:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 338 00000100:00100000:2.0:1787574430.192883:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574430.194233:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323619840 00000100:00100000:3.0:1787574430.194289:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323619840 00000100:00100000:3.0:1787574430.194377:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 339 00000100:00100000:3.0:1787574430.194391:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323619840:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574430.194422:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574430.194447:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca500031e00/0xd18a1efeeddb802b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b5f6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574430.194480:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500031e00/0xd18a1efeeddb802b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5f6 expref: 13 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574430.194492:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca500031e00/0xd18a1efeeddb802b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5f6 expref: 13 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574430.194503:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031e00, rc 0) 00000100:00100000:3.0:1787574430.194582:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:6179:x1874407323619840:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 195us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574430.194590:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 339 00000100:00100000:2.0:1787574430.202943:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574430.204691:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323619968 00000100:00100000:0.0:1787574430.204708:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323619968 00000100:00100000:0.0:1787574430.204794:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 340 00000100:00100000:0.0:1787574430.204806:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:6179:x1874407323619968:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574430.205006:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:6179:x1874407323619968:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 202us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.205016:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 340 00000100:00100000:2.0:1787574430.213160:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574430.213660:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323620096 00000100:00100000:0.0:1787574430.213675:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323620096 00000100:00100000:0.0:1787574430.213750:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 341 00000100:00100000:0.0:1787574430.213761:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:6179:x1874407323620096:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574430.213956:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:6179:x1874407323620096:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 196us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.213965:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 341 00010000:00010000:2.0:1787574430.386866:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574430.450028:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346782208:0@lo:400:kworker.0 00000100:00100000:0.0:1787574430.450153:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346782336:0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.450201:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346781952:0@lo:400:kworker.0 00000100:00100000:0.0:1787574430.453373:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574430.453530:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346782848:0@lo:400:kworker.0 00000100:00100000:0.0:1787574430.453573:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574430.453613:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346783360:0@lo:400:kworker.0 00000100:00100000:0.0:1787574430.453645:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574430.453726:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346782336 00000100:00100000:0.0:1787574430.453736:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346782336 00000100:00100000:0.0:1787574430.453804:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787574430.453815:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346782336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574430.453891:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346782336:12345-0@lo:400:kworker.0 Request processed in 76us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.453899:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787574430.453931:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346782848 00000100:00100000:0.0:1787574430.453935:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346782848 00000100:00100000:0.0:1787574430.453981:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346783360 00000100:00100000:0.0:1787574430.453984:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346783360 00000100:00100000:0.0:1787574430.454007:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787574430.454014:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346782848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574430.454048:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346782848:12345-0@lo:400:kworker.0 Request processed in 35us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.454054:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787574430.454581:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787574430.454591:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346783360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574430.454628:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346783360:12345-0@lo:400:kworker.0 Request processed in 40us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.454635:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787574430.454931:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346782336:0@lo:400:kworker.0 00010000:00080000:0.0:1787574430.454949:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403486680 x1874407346782848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574430.454962:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346782848:0@lo:400:kworker.0 00010000:00080000:0.0:1787574430.454983:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403487480 x1874407346783360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574430.454992:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346783360:0@lo:400:kworker.0 00000100:00080000:3.0:1787574430.455054:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574430.455060:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574430.455087:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346782080:0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.455132:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574430.455171:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346782592:0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.455195:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574430.455215:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346783104:0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.455235:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574430.455620:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346782080 00000100:00100000:0.0:1787574430.455627:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346782080 00000100:00100000:0.0:1787574430.455663:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346782592 00000100:00100000:0.0:1787574430.455666:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346782592 00000100:00100000:0.0:1787574430.455700:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346783104 00000100:00100000:0.0:1787574430.455703:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346783104 00000100:00100000:0.0:1787574430.455718:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787574430.455725:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346782080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574430.455769:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346782080:12345-0@lo:400:kworker.0 Request processed in 44us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.455776:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787574430.455789:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787574430.455795:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346782592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574430.455820:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346782592:12345-0@lo:400:kworker.0 Request processed in 26us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.455825:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787574430.455836:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787574430.455841:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346783104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574430.455863:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346783104:12345-0@lo:400:kworker.0 Request processed in 22us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.455868:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:0.0:1787574430.455890:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574430.455913:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346782080:0@lo:400:kworker.0 00010000:00080000:0.0:1787574430.455934:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca50459b480 x1874407346782592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574430.455944:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346782592:0@lo:400:kworker.0 00010000:00080000:0.0:1787574430.455952:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403485880 x1874407346783104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574430.456203:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574430.456229:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346781952 00000100:00100000:3.0:1787574430.456232:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346781952 00000100:00100000:3.0:1787574430.456488:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787574430.456496:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346781952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.456533:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346781952:12345-0@lo:400:kworker.0 Request processed in 40us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574430.456540:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787574430.456594:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346781952:0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.456604:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346782464:0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.456631:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574430.456653:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346782464 00000100:00100000:3.0:1787574430.456657:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346782464 00000100:00100000:3.0:1787574430.456698:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787574430.456705:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346782464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.456735:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346782464:12345-0@lo:400:kworker.0 Request processed in 31us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574430.456741:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:3.0:1787574430.456757:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574430.456774:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346782464:0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.456783:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346782976:0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.456809:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574430.456830:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346782976 00000100:00100000:3.0:1787574430.456833:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346782976 00000100:00100000:3.0:1787574430.456862:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787574430.456869:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346782976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.456900:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346782976:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574430.456917:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:3.0:1787574430.456934:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574430.456950:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346782976:0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.456973:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346783488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574430.457004:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574430.457027:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346783488 00000100:00100000:3.0:1787574430.457031:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346783488 00000100:00100000:0.0:1787574430.459181:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346783104:0@lo:400:kworker.0 00000100:00100000:0.0:1787574430.459228:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346783616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574430.459376:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787574430.459464:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346783488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574430.459507:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574430.459597:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346783488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 207us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574430.459605:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787574430.459653:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787574430.459702:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504591880 x1874407346783488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574430.459724:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346783488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574430.459824:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574430.459860:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574430.459868:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346783744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574430.459897:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574430.459942:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346783744 00000100:00100000:0.0:1787574430.459949:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346783744 00000100:00100000:0.0:1787574430.459992:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787574430.460000:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346783744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574430.460029:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787574430.460198:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346783744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 198us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.460205:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787574430.460379:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346783744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574430.460749:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346783616 00000100:00100000:3.0:1787574430.460755:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346783616 00000100:00100000:3.0:1787574430.460786:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787574430.460795:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346783616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574430.460809:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574430.460856:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346783616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574430.460863:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1787574430.460903:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504592300 x1874407346783616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574430.460919:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346783616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574430.463377:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574430.463566:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346782720:0@lo:400:kworker.0 00000100:00100000:1.0:1787574430.463612:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574430.463636:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346783232:0@lo:400:kworker.0 00000100:00100000:1.0:1787574430.463657:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574430.463710:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346782720 00000100:00100000:1.0:1787574430.463717:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346782720 00000100:00100000:1.0:1787574430.463785:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346783232 00000100:00100000:1.0:1787574430.463788:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346783232 00000100:00100000:1.0:1787574430.463807:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787574430.463816:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346782720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574430.463867:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346782720:12345-0@lo:400:kworker.0 Request processed in 51us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574430.463874:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787574430.463893:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787574430.463898:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346783232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574430.463919:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346783232:12345-0@lo:400:kworker.0 Request processed in 22us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574430.463925:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1787574430.463947:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787574430.463973:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403486d80 x1874407346782720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574430.463988:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346782720:0@lo:400:kworker.0 00010000:00080000:1.0:1787574430.463997:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403485500 x1874407346783232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574430.464006:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346783232:0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.469696:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346782208 00000100:00100000:3.0:1787574430.469720:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346782208 00000100:00100000:3.0:1787574430.469816:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787574430.469830:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346782208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574430.470033:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346782208:12345-0@lo:400:kworker.0 Request processed in 206us (6665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574430.470041:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787574430.479382:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574430.479431:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574430.479462:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574430.479490:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323620224 00000100:00100000:0.0:1787574430.479491:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574430.479505:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323620224 00000100:00100000:0.0:1787574430.479526:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323620480 00000100:00100000:0.0:1787574430.479530:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323620480 00000100:00100000:3.0:1787574430.479587:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323620352 00000100:00100000:3.0:1787574430.479591:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323620352 00000100:00100000:1.0:1787574430.479796:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346782208:0@lo:400:kworker.0 00000100:00080000:1.0:1787574430.479836:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574430.479841:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574430.482182:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323620608 00000100:00100000:1.0:1787574430.482199:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323620608 00000100:00100000:0.0:1787574430.482763:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 239 00000100:00100000:0.0:1787574430.482781:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323620224:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574430.482899:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323620224:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 123us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.482907:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 239 00000100:00100000:0.0:1787574430.482930:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 240 00000100:00100000:0.0:1787574430.482938:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323620480:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574430.482969:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323620480:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (3539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574430.482974:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 240 00000100:00100000:3.0:1787574430.489190:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 241 00000100:00100000:3.0:1787574430.489222:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323620352:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:0.0:1787574430.489384:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574430.490464:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323620352:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1252us (10993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574430.490479:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 241 00000100:00100000:1.0:1787574430.494548:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 242 00000100:00100000:1.0:1787574430.494571:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323620608:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574430.494706:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323620608:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 145us (15213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574430.494715:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 242 00010000:00010000:3.0:1787574431.409627:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574432.445940:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787574433.215054:0:13383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787574433.462384:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574433.530627:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346783872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574433.530709:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574433.530789:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346783872 00000100:00100000:0.0:1787574433.530797:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346783872 00000100:00100000:0.0:1787574433.530850:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787574433.530861:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346783872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574433.530890:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574433.530936:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346783872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574433.530943:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787574433.530964:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574433.530997:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366e300 x1874407346783872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574433.531038:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346783872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574433.531336:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574433.531347:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346784000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574433.531376:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574433.531405:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346784000 00000100:00100000:1.0:1787574433.531409:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346784000 00000100:00100000:1.0:1787574433.531450:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787574433.531458:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346784000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574433.531470:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574433.531501:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346784000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574433.531507:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1787574433.531522:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787574433.531539:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403485500 x1874407346784000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574433.531553:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346784000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787574434.483027:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574435.057569:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574435.057593:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346784128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574435.057679:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.057900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346784128 00000100:00100000:0.0:1787574435.057908:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346784128 00000100:00100000:0.0:1787574435.057963:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787574435.057973:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346784128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574435.058015:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574435.058072:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346784128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.058079:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787574435.058223:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346784128:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787574435.505866:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574435.572100:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346784256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574435.572171:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.572270:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346784256 00000100:00100000:0.0:1787574435.572278:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346784256 00000100:00100000:0.0:1787574435.572331:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787574435.572342:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346784256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574435.572381:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574435.572427:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346784256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.572434:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1787574435.572455:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787574435.572568:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366e300 x1874407346784256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574435.572586:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346784256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574435.572766:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574435.572778:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346784384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574435.572811:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574435.572842:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346784384 00000100:00100000:3.0:1787574435.572846:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346784384 00000100:00100000:3.0:1787574435.572876:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787574435.572883:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346784384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574435.572924:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574435.572961:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346784384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574435.572968:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787574435.573002:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346784384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574435.578391:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346784512:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.578481:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.578525:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346785024:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.578553:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.578571:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346785536:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.578606:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.578630:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787574435.578647:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346784896:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.578669:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.578685:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346785408:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.578704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.578731:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346784512 00000100:00100000:0.0:1787574435.578738:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346784512 00000100:00100000:0.0:1787574435.578788:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787574435.578797:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346784512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.578843:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346784512:12345-0@lo:400:kworker.0 Request processed in 46us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.578850:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787574435.578880:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346785024 00000100:00100000:0.0:1787574435.578884:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346785024 00000100:00100000:0.0:1787574435.578914:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346785536 00000100:00100000:0.0:1787574435.578917:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346785536 00000100:00100000:0.0:1787574435.578928:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346784896 00000100:00100000:0.0:1787574435.578931:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346784896 00000100:00100000:0.0:1787574435.578941:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346785408 00000100:00100000:0.0:1787574435.578943:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346785408 00000100:00100000:0.0:1787574435.578955:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787574435.578961:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346785024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579005:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346785024:12345-0@lo:400:kworker.0 Request processed in 44us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.579012:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787574435.579023:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787574435.579029:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346785536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579054:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346785536:12345-0@lo:400:kworker.0 Request processed in 24us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.579059:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787574435.579069:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787574435.579075:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346784896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579100:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346784896:12345-0@lo:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.579106:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787574435.579116:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787574435.579122:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346785408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579147:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346785408:12345-0@lo:400:kworker.0 Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.579152:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787574435.579186:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346784640:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579211:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.579228:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346785152:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.579290:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346785664:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579310:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.579337:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787574435.579343:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346784768:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579363:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.579376:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346785280:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579394:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574435.579417:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346785152 00000100:00100000:0.0:1787574435.579421:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346785152 00000100:00100000:0.0:1787574435.579444:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346785664 00000100:00100000:0.0:1787574435.579446:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346785664 00000100:00100000:0.0:1787574435.579457:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346785280 00000100:00100000:0.0:1787574435.579460:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346785280 00000100:00100000:0.0:1787574435.579470:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787574435.579476:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346785152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579509:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346785152:12345-0@lo:400:kworker.0 Request processed in 33us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.579515:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787574435.579528:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787574435.579533:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346785664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579561:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346785664:12345-0@lo:400:kworker.0 Request processed in 28us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.579566:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787574435.579577:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787574435.579584:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346785280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579607:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346785280:12345-0@lo:400:kworker.0 Request processed in 25us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.579612:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787574435.579647:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346784640 00000100:00100000:0.0:1787574435.579656:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346784640 00000100:00100000:0.0:1787574435.579680:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346784768 00000100:00100000:0.0:1787574435.579682:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346784768 00000100:00100000:0.0:1787574435.579696:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787574435.579701:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346784640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579731:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346784640:12345-0@lo:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.579737:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787574435.579747:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787574435.579753:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346784768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579777:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346784768:12345-0@lo:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.579783:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1787574435.579808:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574435.579812:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574435.579814:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574435.579816:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574435.579848:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346784768:0@lo:400:kworker.0 00010000:00080000:0.0:1787574435.579860:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402504000 x1874407346785280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574435.579871:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346785280:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579879:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346784640:0@lo:400:kworker.0 00010000:00080000:0.0:1787574435.579888:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366e300 x1874407346785152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574435.579896:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346785152:0@lo:400:kworker.0 00010000:00080000:0.0:1787574435.579916:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402506a00 x1874407346785664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574435.579924:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346785664:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579965:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346784896:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579975:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346785408:0@lo:400:kworker.0 00000100:00100000:0.0:1787574435.579985:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346784512:0@lo:400:kworker.0 00010000:00080000:0.0:1787574435.579994:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034ddf80 x1874407346785024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574435.580003:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346785024:0@lo:400:kworker.0 00010000:00080000:0.0:1787574435.580012:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402504a80 x1874407346785536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574435.580019:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346785536:0@lo:400:kworker.0 00000100:00100000:2.0:1787574435.583955:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346785792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574435.584028:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574435.584089:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346785792 00000100:00100000:2.0:1787574435.584096:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346785792 00000100:00100000:2.0:1787574435.584147:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787574435.584157:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346785792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574435.584180:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574435.584227:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346785792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574435.584235:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1787574435.584298:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d51f80 x1874407346785792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574435.584315:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346785792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574435.599228:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574435.599296:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574435.599328:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574435.599352:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574435.599376:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574435.599402:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323620736 00000100:00100000:0.0:1787574435.599412:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323620736 00000100:00100000:0.0:1787574435.599463:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 344 00000100:00100000:0.0:1787574435.599474:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2402:x1874407323620736:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574435.599549:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2402:x1874407323620736:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.599565:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 344 00000100:00100000:0.0:1787574435.599710:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323620864 00000100:00100000:0.0:1787574435.599715:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323620864 00000100:00100000:0.0:1787574435.599747:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323621120 00000100:00100000:0.0:1787574435.599750:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323621120 00000100:00100000:0.0:1787574435.599766:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323620992 00000100:00100000:0.0:1787574435.599768:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323620992 00000100:00100000:0.0:1787574435.599778:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323621248 00000100:00100000:0.0:1787574435.599781:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323621248 00000100:00100000:0.0:1787574435.599795:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 249 00000100:00100000:0.0:1787574435.599801:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323620864:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574435.599840:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323620864:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 39us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.599848:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 249 00000100:00100000:0.0:1787574435.599861:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 250 00000100:00100000:0.0:1787574435.599867:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323621120:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574435.599892:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323621120:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.599898:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 250 00000100:00100000:0.0:1787574435.599909:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 251 00000100:00100000:0.0:1787574435.599915:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323620992:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574435.599940:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323620992:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.599945:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 251 00000100:00100000:0.0:1787574435.599955:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 252 00000100:00100000:0.0:1787574435.599970:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323621248:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574435.599997:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323621248:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574435.600003:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 252 00000100:00080000:0.0:1787574435.600100:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574435.600106:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787574436.529752:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574437.553427:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574438.577811:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574438.641915:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346785920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574438.641997:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574438.642080:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346785920 00000100:00100000:0.0:1787574438.642088:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346785920 00000100:00100000:0.0:1787574438.642137:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787574438.642147:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346785920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574438.642174:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574438.642219:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346785920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574438.642225:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1787574438.642264:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574438.642292:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403485500 x1874407346785920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574438.642309:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346785920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574438.643026:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346786048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574438.643067:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574438.643132:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346786048 00000100:00100000:2.0:1787574438.643137:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346786048 00000100:00100000:2.0:1787574438.643174:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787574438.643181:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346786048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574438.643197:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574438.643233:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346786048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574438.643258:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1787574438.643276:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574438.643294:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403486680 x1874407346786048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574438.643310:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346786048:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787574439.601379:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574440.180037:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346786176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574440.180121:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574440.180360:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346786176 00000100:00100000:0.0:1787574440.180368:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346786176 00000100:00100000:0.0:1787574440.181132:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787574440.181145:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346786176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574440.181198:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574440.181280:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346786176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.181287:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787574440.181465:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346786176:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574440.625400:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574440.690061:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346786304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574440.690169:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574440.690328:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346786304 00000100:00100000:3.0:1787574440.690339:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346786304 00000100:00100000:3.0:1787574440.690415:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787574440.690428:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346786304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574440.690466:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574440.691644:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346786304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574440.691658:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1787574440.691874:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574440.691899:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346786432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574440.692235:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574440.692320:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346786432 00000100:00100000:3.0:1787574440.692328:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346786432 00000100:00100000:3.0:1787574440.692372:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787574440.692380:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346786432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574440.692418:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574440.692465:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346786432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574440.692490:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787574440.693665:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346786432:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1787574440.693736:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504592300 x1874407346786304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574440.693754:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346786304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574440.697831:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346786688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574440.697922:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346786560:0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.697922:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574440.698008:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346787200:0@lo:400:kworker.0 00000100:00100000:3.0:1787574440.698018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574440.709858:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574440.709935:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346787712:0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.709991:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574440.710021:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787574440.710028:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346786816:0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.710051:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574440.710069:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346787328:0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.710092:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574440.710115:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346787840:0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.710136:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574440.710171:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346786688 00000100:00100000:0.0:1787574440.710179:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346786688 00000100:00100000:0.0:1787574440.710253:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787574440.710263:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346786688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574440.710288:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574440.710332:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346786688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (12413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.710338:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787574440.710383:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346787200 00000100:00100000:0.0:1787574440.710387:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346787200 00000100:00100000:0.0:1787574440.711005:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346787712 00000100:00100000:0.0:1787574440.711011:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346787712 00000100:00100000:0.0:1787574440.711042:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346786816 00000100:00100000:0.0:1787574440.711045:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346786816 00000100:00100000:0.0:1787574440.711061:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787574440.711068:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346787200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.711114:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346787200:12345-0@lo:400:kworker.0 Request processed in 46us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.711121:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787574440.711134:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787574440.711141:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346787712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.711169:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346787712:12345-0@lo:400:kworker.0 Request processed in 29us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.711175:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787574440.711186:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787574440.711192:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346786816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.711221:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346786816:12345-0@lo:400:kworker.0 Request processed in 29us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.711226:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787574440.711274:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346787328 00000100:00100000:0.0:1787574440.711279:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346787328 00000100:00100000:0.0:1787574440.711303:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346787840 00000100:00100000:0.0:1787574440.711307:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346787840 00000100:00100000:0.0:1787574440.711324:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787574440.711331:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346787328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.711363:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346787328:12345-0@lo:400:kworker.0 Request processed in 33us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574440.713272:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346786944:0@lo:400:kworker.0 00000100:00100000:2.0:1787574440.713336:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574440.713819:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787574440.713848:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787574440.713861:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346787840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.713917:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346787840:12345-0@lo:400:kworker.0 Request processed in 62us (3780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.713924:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787574440.713950:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346786944 00000100:00100000:0.0:1787574440.713957:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346786944 00000100:00100000:0.0:1787574440.713992:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787574440.713998:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346786944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.714030:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346786944:12345-0@lo:400:kworker.0 Request processed in 33us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.714036:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:0.0:1787574440.714064:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574440.714070:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574440.714073:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574440.714123:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346786816:0@lo:400:kworker.0 00010000:00080000:0.0:1787574440.714141:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53be5f100 x1874407346787328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574440.714152:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346787328:0@lo:400:kworker.0 00010000:00080000:0.0:1787574440.714164:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025ff100 x1874407346787840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574440.714174:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346787840:0@lo:400:kworker.0 00010000:00080000:0.0:1787574440.714187:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53be5ce00 x1874407346787200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574440.714203:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346787200:0@lo:400:kworker.0 00010000:00080000:0.0:1787574440.714218:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025fc700 x1874407346787712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574440.714226:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346787712:0@lo:400:kworker.0 00010000:00080000:0.0:1787574440.714253:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402506a00 x1874407346786688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574440.714269:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346786688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574440.714329:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346786560 00000100:00100000:0.0:1787574440.714333:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346786560 00000100:00100000:0.0:1787574440.714361:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787574440.714367:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346786560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574440.714886:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346786944:0@lo:400:kworker.0 00000100:00100000:2.0:1787574440.714895:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346787456:0@lo:400:kworker.0 00000100:00100000:2.0:1787574440.714929:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574440.714968:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346787456 00000100:00100000:2.0:1787574440.714972:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346787456 00000100:00100000:2.0:1787574440.715003:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787574440.715010:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346787456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574440.715047:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346787456:12345-0@lo:400:kworker.0 Request processed in 37us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574440.715060:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1787574440.715079:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574440.715095:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53be5c000 x1874407346787456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574440.715105:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346787456:0@lo:400:kworker.0 00000100:00100000:3.0:1787574440.715799:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346786560:0@lo:400:kworker.0 00000100:00100000:3.0:1787574440.715817:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346787072:0@lo:400:kworker.0 00000100:00100000:3.0:1787574440.715881:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574440.715921:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346787584:0@lo:400:kworker.0 00000100:00100000:3.0:1787574440.715958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574440.715995:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346787072 00000100:00100000:3.0:1787574440.716001:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346787072 00000100:00100000:3.0:1787574440.716053:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346787584 00000100:00100000:3.0:1787574440.716057:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346787584 00000100:00100000:3.0:1787574440.716086:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787574440.716095:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346787072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574440.716141:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346787072:12345-0@lo:400:kworker.0 Request processed in 47us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574440.716148:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787574440.716166:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787574440.716171:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346787584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574440.716473:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346787584:12345-0@lo:400:kworker.0 Request processed in 300us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574440.716481:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:3.0:1787574440.716521:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574440.716548:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346787584:0@lo:400:kworker.0 00000100:00100000:3.0:1787574440.716727:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346787072:0@lo:400:kworker.0 00000100:00100000:0.0:1787574440.718760:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346786560:12345-0@lo:400:kworker.0 Request processed in 49us (16400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.718780:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787574440.738513:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574440.738580:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323621376 00000100:00100000:0.0:1787574440.738581:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574440.738605:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323621376 00000100:00100000:0.0:1787574440.738628:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574440.738676:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 346 00000100:00100000:0.0:1787574440.738678:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574440.738696:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323621376:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574440.738730:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574440.738770:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323621504 00000100:00100000:0.0:1787574440.738778:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323621504 00000100:00100000:1.0:1787574440.738812:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323621376:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 118us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574440.738828:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 346 00000100:00100000:0.0:1787574440.738856:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323621632 00000100:00100000:0.0:1787574440.738862:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323621632 00000100:00100000:0.0:1787574440.738889:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323621888 00000100:00100000:0.0:1787574440.738893:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323621888 00000100:00100000:0.0:1787574440.738920:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323621760 00000100:00100000:0.0:1787574440.738923:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323621760 00000100:00100000:0.0:1787574440.738957:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 259 00000100:00100000:0.0:1787574440.738967:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323621504:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574440.739032:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323621504:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 66us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.739040:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 259 00000100:00100000:0.0:1787574440.739057:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 260 00000100:00100000:0.0:1787574440.739064:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323621632:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574440.739095:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323621632:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 32us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.739101:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 260 00000100:00100000:0.0:1787574440.739123:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 261 00000100:00100000:0.0:1787574440.739131:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323621888:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574440.739168:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323621888:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 37us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.739178:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 261 00000100:00100000:0.0:1787574440.739193:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 262 00000100:00100000:0.0:1787574440.739216:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323621760:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:1.0:1787574440.739266:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574440.739274:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574440.739310:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323621760:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 93us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574440.739320:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 262 00000001:02000400:3.0:1787574440.926795:0:13532:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:27:17 (1787574437) === 00000100:00100000:0.0:1787574441.253169:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574441.253218:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323622016 00000100:00100000:0.0:1787574441.253272:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323622016 00000100:00100000:0.0:1787574441.253354:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1787574441.253367:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323622016:12345-192.168.202.40@tcp:41:mkdir.0 00000004:00000024:0.0:1787574441.253419:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574441.253655:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323622016:12345-192.168.202.40@tcp:41:mkdir.0 Request processed in 289us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574441.253664:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1787574441.253714:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574441.253741:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323622144 00000100:00100000:0.0:1787574441.253746:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323622144 00000100:00100000:0.0:1787574441.253769:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:0.0:1787574441.253776:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:10526:x1874407323622144:12345-192.168.202.40@tcp:700:mkdir.0 00000100:00100000:0.0:1787574441.253814:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:10526:x1874407323622144:12345-192.168.202.40@tcp:700:mkdir.0 Request processed in 39us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574441.253820:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1787574441.270445:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574441.275415:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323622400 00000100:00100000:1.0:1787574441.275439:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323622400 00000100:00100000:1.0:1787574441.279010:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1787574441.279039:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:10526:x1874407323622400:12345-192.168.202.40@tcp:36:mkdir.0 00010000:00010000:1.0:1787574441.279137:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574441.283901:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb7ed4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b56a expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.283927:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca52057ff00) 00010000:00010000:1.0:1787574441.283955:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574441.284058:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8032 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.284070:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8032 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.284080:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8032 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.284110:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.284118:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.284143:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.286942:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.286964:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.286976:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574441.286993:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb1a958d reply state 0000000017350b2d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.287003:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.287011:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca51874a300) 00010000:00010000:1.0:1787574441.287014:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787574441.287018:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787574441.287024:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787574441.287031:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8032 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.287037:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8032 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.287044:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8032 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.287050:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574441.287060:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8032 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.287067:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8032 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.287079:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca51874a800) 00010000:00010000:1.0:1787574441.287081:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574441.287085:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8032 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.287092:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8032 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574441.287111:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb1a958d reply state 0000000017350b2d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.287119:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.287125:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ca51874ae00) 00010000:00010000:1.0:1787574441.287127:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787574441.287129:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787574441.287318:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:10526:x1874407323622400:12345-192.168.202.40@tcp:36:mkdir.0 Request processed in 8288us (16886us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787574441.287327:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:0.0:1787574441.308831:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574441.308896:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323622528 00000100:00100000:3.0:1787574441.308914:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323622528 00000100:00100000:3.0:1787574441.309001:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1787574441.309014:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:10527:x1874407323622528:12345-192.168.202.40@tcp:101:chmod.0 00010000:00010000:3.0:1787574441.309061:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574441.309096:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb8047 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b5fd expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.309186:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb804e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.309203:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb804e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.309218:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb804e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574441.309316:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787574441.309321:0:8610:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574441.309368:0:8610:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb804e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.309426:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb8047 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5fd expref: 9 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.309447:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb804e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5fd expref: 8 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.309456:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca5186ca100) 00010000:00010000:3.0:1787574441.309459:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574441.309463:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99a00, rc 0) 00000100:00100000:3.0:1787574441.309556:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:10527:x1874407323622528:12345-192.168.202.40@tcp:101:chmod.0 Request processed in 544us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574441.309564:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1787574441.316526:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574441.316626:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323622784 00000100:00100000:3.0:1787574441.316644:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323622784 00000100:00100000:3.0:1787574441.316733:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1787574441.316747:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:10527:x1874407323622784:12345-192.168.202.40@tcp:36:chmod.0 00010000:00010000:3.0:1787574441.316820:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574441.316855:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb804e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5fd expref: 8 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.316875:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca5186ca100) 00010000:00010000:3.0:1787574441.316887:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574441.316920:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.316937:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.316967:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574441.317261:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e28b175c reply state 000000005e7e2736 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.317275:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.317282:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca5186ca900) 00010000:00010000:3.0:1787574441.317284:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787574441.317287:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787574441.317296:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787574441.317398:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:10527:x1874407323622784:12345-192.168.202.40@tcp:36:chmod.0 Request processed in 653us (878us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787574441.317406:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1787574441.361508:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574441.362183:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323622912 00000100:00100000:1.0:1787574441.362198:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323622912 00000100:00100000:2.0:1787574441.362719:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:2.0:1787574441.362734:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:10528:x1874407323622912:12345-192.168.202.40@tcp:101:chown.0 00010000:00010000:2.0:1787574441.362768:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574441.362797:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb805c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b604 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.362882:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82400/0xd18a1efeeddb8063 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.362899:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82400/0xd18a1efeeddb8063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.362912:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82400/0xd18a1efeeddb8063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574441.362976:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787574441.362981:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574441.363028:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82400/0xd18a1efeeddb8063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.363077:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb805c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b604 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.363124:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82400/0xd18a1efeeddb8063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b604 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.363134:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca5186ca900) 00010000:00010000:2.0:1787574441.363138:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574441.363143:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82400, rc 0) 00000100:00100000:2.0:1787574441.363236:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:10528:x1874407323622912:12345-192.168.202.40@tcp:101:chown.0 Request processed in 505us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574441.363290:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1787574441.373394:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574441.373552:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323623040 00000100:00100000:0.0:1787574441.373566:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323623040 00000100:00100000:0.0:1787574441.373657:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:0.0:1787574441.373670:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:10528:x1874407323623040:12345-192.168.202.40@tcp:101:chown.0 00010000:00010000:0.0:1787574441.373698:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574441.373906:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb806a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b60b expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.373997:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb8071 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374031:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb8071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374045:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb8071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374060:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb8078 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374069:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb8078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374075:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb8078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374176:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb807f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374185:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb807f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374192:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb807f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574441.374283:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574441.374287:0:11515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574441.374316:0:11515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb807f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374331:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb8071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374349:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb8071 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374356:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb8071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374362:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574441.374367:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb8071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374375:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb8071 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374390:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca5186ca900) 00010000:00010000:0.0:1787574441.374393:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574441.374398:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb8071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374405:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb8071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374421:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb8078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374427:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb8078 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374433:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb8078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374438:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574441.374446:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb8078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374452:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb8078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374461:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ca51874ae00) 00010000:00010000:0.0:1787574441.374463:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574441.374467:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb8078 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374472:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb8078 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374516:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb806a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b60b expref: 12 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374532:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb807f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b60b expref: 11 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.374541:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca51874a300) 00010000:00010000:0.0:1787574441.374544:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574441.374547:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11200, rc 0) 00000100:00100000:0.0:1787574441.375005:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:10528:x1874407323623040:12345-192.168.202.40@tcp:101:chown.0 Request processed in 1334us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574441.375016:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1787574441.377897:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574441.378150:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323623168 00000100:00100000:1.0:1787574441.378163:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323623168 00000100:00100000:2.0:1787574441.378848:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:2.0:1787574441.378867:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:10528:x1874407323623168:12345-192.168.202.40@tcp:900:chown.0 00000100:00100000:2.0:1787574441.378984:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:10528:x1874407323623168:12345-192.168.202.40@tcp:900:chown.0 Request processed in 122us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574441.378993:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:3.0:1787574441.383082:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574441.383662:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323623424 00000100:00100000:0.0:1787574441.383676:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323623424 00000100:00100000:0.0:1787574441.383897:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1787574441.383911:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:10528:x1874407323623424:12345-192.168.202.40@tcp:36:chown.0 00010000:00010000:0.0:1787574441.384002:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574441.384049:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb807f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b60b expref: 11 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.384074:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca51874a300) 00010000:00010000:0.0:1787574441.384080:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574441.384111:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.384126:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.384137:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574441.396420:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1787574441.396623:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396640:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396651:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396658:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574441.396665:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396675:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396710:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ca51874ae00) 00010000:00010000:0.0:1787574441.396723:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574441.396730:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396737:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb8039 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396763:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396769:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396774:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396779:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574441.396781:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396787:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396795:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca51874a300) 00010000:00010000:0.0:1787574441.396797:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574441.396800:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396806:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75600/0xd18a1efeeddb8040 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396831:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396837:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396843:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396847:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be98800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574441.396850:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396856:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396864:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca5186ca900) 00010000:00010000:0.0:1787574441.396866:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787574441.396869:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.396875:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8055 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574441.398096:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fea2346 reply state 000000004e5ef5d2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.398125:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.398134:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca51874a300) 00010000:00010000:3.0:1787574441.398138:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787574441.398142:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787574441.398160:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1787574441.398339:0:6511:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787574441.398383:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:10528:x1874407323623424:12345-192.168.202.40@tcp:36:chown.0 Request processed in 14469us (15309us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787574441.398393:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00010000:00010000:2.0:1787574441.398550:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.398562:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.398570:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.398577:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574441.398591:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.398610:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.398625:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca51874a300) 00010000:00010000:2.0:1787574441.398628:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787574441.398632:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.398640:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8086 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574441.444701:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574441.451589:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323623552 00000100:00100000:2.0:1787574441.451611:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323623552 00000100:00100000:2.0:1787574441.451723:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:2.0:1787574441.451736:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:10529:x1874407323623552:12345-192.168.202.40@tcp:101:touch.500 00010000:00010000:2.0:1787574441.451769:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574441.451796:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb808d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b612 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787574441.468915:0:6509:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 17050us 00010000:00010000:3.0:1787574441.499320:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8094 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499346:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8094 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499362:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8094 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499380:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb809b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499386:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb809b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499392:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb809b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499567:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb80a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499575:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb80a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499592:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb80a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574441.499634:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787574441.499645:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574441.499691:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb80a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499706:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8094 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499713:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8094 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499721:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8094 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499726:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574441.499732:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8094 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499740:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8094 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499754:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca5186ca900) 00010000:00010000:3.0:1787574441.499757:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574441.499762:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8094 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499769:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8094 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499781:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb809b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499787:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb809b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499803:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb809b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499809:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574441.499811:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb809b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499820:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb809b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499828:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ca5186ca100) 00010000:00010000:3.0:1787574441.499830:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574441.499833:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb809b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499839:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb809b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499885:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb808d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b612 expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499901:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb80a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b612 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.499909:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca5186ca700) 00010000:00010000:3.0:1787574441.499911:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787574441.499914:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be98c00, rc 0) 00000100:00100000:3.0:1787574441.500005:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:10529:x1874407323623552:12345-192.168.202.40@tcp:101:touch.500 Request processed in 48269us (55318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574441.500022:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1787574441.512728:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574441.513337:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323623808 00000100:00100000:3.0:1787574441.513352:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323623808 00000100:00100000:3.0:1787574441.513437:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:3.0:1787574441.513451:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:10529:x1874407323623808:12345-192.168.202.40@tcp:101:touch.500 00010000:00010000:3.0:1787574441.513481:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574441.513507:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b619 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.513666:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb80b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.513685:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb80b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.513698:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb80b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.513770:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x44ff825f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.513778:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.513787:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787574441.514485:0:11515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787574441.514681:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb80be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514712:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb80be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514720:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb80be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514762:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb80b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514769:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb80b0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514776:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb80b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514782:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574441.514787:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb80b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514794:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb80b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514808:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca5186ca700) 00010000:00010000:3.0:1787574441.514811:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574441.514816:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb80b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514822:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb80b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574441.514835:0:11515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ab7f7ce reply state 000000006820607c transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514853:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514859:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x44ff825f (ffff9ca5186ca100) 00010000:00010000:3.0:1787574441.514861:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574441.514864:0:11515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787574441.514901:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b619 expref: 10 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514917:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb80be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b619 expref: 9 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.514925:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ca5186cad00) 00010000:00010000:3.0:1787574441.514928:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574441.514931:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be98800, rc 0) 00000100:00100000:3.0:1787574441.516688:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:10529:x1874407323623808:12345-192.168.202.40@tcp:101:touch.500 Request processed in 3227us (3963us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787574441.516702:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:0.0:1787574441.541006:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574441.541189:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323624064 00000100:00100000:3.0:1787574441.541203:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323624064 00000100:00100000:3.0:1787574441.541316:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1787574441.541330:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:10529:x1874407323624064:12345-192.168.202.40@tcp:36:touch.500 00010000:00010000:3.0:1787574441.541408:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574441.541445:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb80be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b619 expref: 10 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.541469:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ca5186cad00) 00010000:00010000:3.0:1787574441.541502:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574441.541574:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.541601:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.541613:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574441.541754:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdeef217 reply state 00000000f1f406d9 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.541768:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.541775:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ca5186ca300) 00010000:00010000:3.0:1787574441.541778:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574441.541781:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787574441.541905:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:10529:x1874407323624064:12345-192.168.202.40@tcp:36:touch.500 Request processed in 577us (912us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787574441.541913:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:0.0:1787574441.550758:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574441.550855:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323624192 00000100:00100000:3.0:1787574441.550867:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323624192 00000100:00100000:3.0:1787574441.550950:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:3.0:1787574441.550961:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:10529:x1874407323624192:12345-192.168.202.40@tcp:101:touch.500 00010000:00010000:3.0:1787574441.550996:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574441.551022:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb80d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b620 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.551093:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb80d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b620 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.551126:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb80d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b620 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574441.551144:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ca5186ca300) 00010000:00010000:3.0:1787574441.551147:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574441.551150:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be98800, rc 0) 00000100:00100000:3.0:1787574441.551229:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:10529:x1874407323624192:12345-192.168.202.40@tcp:101:touch.500 Request processed in 269us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574441.551237:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:1.0:1787574441.560855:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574441.561036:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323624320 00000100:00100000:0.0:1787574441.561050:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323624320 00000100:00100000:0.0:1787574441.561116:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1787574441.561127:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874407323624320:12345-192.168.202.40@tcp:8:touch.500 00010000:00080000:0.0:1787574441.561194:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp t0 exp 0000000000000000 cur 380 last 0 00000020:00000080:0.0:1787574441.561386:0:8425:0:(genops.c:1385:class_connect()) connect: client 1aeb3668-c6f6-4338-ab9b-0a7c9161b421, cookie 0xd18a1efeeddb80da 00002000:00100000:0.0:1787574441.561404:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1aeb3668-c6f6-4338-ab9b-0a7c9161b421/ffff9ca402710000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787574441.561432:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787574441.561539:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787574441.561578:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9ca402717800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574441.561678:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2401:x1874407323624320:12345-192.168.202.40@tcp:8:touch.500 Request processed in 551us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574441.561686:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:1.0:1787574441.571797:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574441.571910:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323624448 00000100:00100000:2.0:1787574441.571924:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323624448 00000100:00100000:2.0:1787574441.572032:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:2.0:1787574441.572045:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:0:x1874407323624448:12345-192.168.202.40@tcp:2:touch.500 00000100:00080000:1.0:1787574441.572675:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787574441.575848:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1787574441.575867:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000100:00100000:2.0:1787574441.581409:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:0:x1874407323624448:12345-192.168.202.40@tcp:2:touch.500 Request processed in 9350us (9611us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787574441.581428:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:2.0:1787574441.585376:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574441.585513:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323624704 00000100:00100000:3.0:1787574441.585526:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323624704 00000100:00100000:3.0:1787574441.585602:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1787574441.585616:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:10529:x1874407323624704:12345-192.168.202.40@tcp:35:touch.500 00000100:00100000:3.0:1787574441.586000:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:10529:x1874407323624704:12345-192.168.202.40@tcp:35:touch.500 Request processed in 386us (638us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787574441.586009:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:1.0:1787574441.630791:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574441.631167:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323624832 00000100:00100000:3.0:1787574441.631280:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323624832 00000100:00100000:0.0:1787574441.631381:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:0.0:1787574441.631398:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:10530:x1874407323624832:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:0.0:1787574441.631430:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574441.631457:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb80e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b627 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.631624:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb80e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.631642:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb80e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.631656:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb80e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574441.631712:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574441.631764:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574441.631812:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb80e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.631864:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb80e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b627 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.632010:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb80e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b627 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.632023:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca5186ca700) 00010000:00010000:0.0:1787574441.632026:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574441.632031:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10000, rc 0) 00000100:00100000:0.0:1787574441.632152:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:10530:x1874407323624832:12345-192.168.202.40@tcp:101:rm.0 Request processed in 759us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574441.632160:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:2.0:1787574441.647865:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574441.647975:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323625088 00000100:00100000:0.0:1787574441.647990:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323625088 00000100:00100000:0.0:1787574441.648065:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:0.0:1787574441.648078:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:10530:x1874407323625088:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:0.0:1787574441.648105:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574441.648130:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb80ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b62e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574441.648304:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787574441.648418:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb80ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b62e expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.648432:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca5186ca900) 00010000:00010000:0.0:1787574441.648434:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574441.648453:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb80ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b62e expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.648467:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10800, rc 0) 00000100:00100000:0.0:1787574441.648524:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:10530:x1874407323625088:12345-192.168.202.40@tcp:101:rm.0 Request processed in 450us (676us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1787574441.648529:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:2.0:1787574441.652922:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574441.653061:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323625216 00000100:00100000:3.0:1787574441.653075:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323625216 00000100:00100000:3.0:1787574441.653154:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1787574441.653167:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:10530:x1874407323625216:12345-192.168.202.40@tcp:37:rm.0 00010000:00010000:0.0:1787574441.653848:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574441.658594:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:10530:x1874407323625216:12345-192.168.202.40@tcp:37:rm.0 Request processed in 5406us (5666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574441.658626:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:1.0:1787574441.668652:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574441.668773:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323625472 00000100:00100000:0.0:1787574441.668787:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323625472 00000100:00100000:0.0:1787574441.668860:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:0.0:1787574441.668872:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b65bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:10530:x1874407323625472:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1787574441.669172:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b65bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:10530:x1874407323625472:12345-192.168.202.40@tcp:35:rm.0 Request processed in 301us (534us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787574441.669181:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:2.0:1787574441.675814:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574441.675942:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323625728 00000100:00100000:0.0:1787574441.675956:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323625728 00000100:00100000:0.0:1787574441.676221:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:0.0:1787574441.676235:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:10530:x1874407323625728:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:0.0:1787574441.676308:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574441.676336:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb80fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b635 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.676492:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8104 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.676759:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8104 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.676805:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8104 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574441.676823:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787574441.677149:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb80fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b635 expref: 19 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.677174:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8104 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b635 expref: 18 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.677184:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca5186ca700) 00010000:00010000:1.0:1787574441.677187:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787574441.677191:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11a00, rc 0) 00000100:00100000:1.0:1787574441.677337:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:10530:x1874407323625728:12345-192.168.202.40@tcp:101:rm.0 Request processed in 1105us (1539us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787574441.677345:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:1.0:1787574441.688401:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574441.688446:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323625856 00000100:00100000:0.0:1787574441.688460:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323625856 00000100:00100000:0.0:1787574441.688744:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:0.0:1787574441.688761:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:10530:x1874407323625856:12345-192.168.202.40@tcp:41:rm.0 00000004:00000024:0.0:1787574441.688852:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1787574441.688956:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:10530:x1874407323625856:12345-192.168.202.40@tcp:41:rm.0 Request processed in 201us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574441.689364:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:0.0:1787574441.693307:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574441.694090:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323625984 00000100:00100000:2.0:1787574441.694106:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323625984 00000100:00100000:2.0:1787574441.694188:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:2.0:1787574441.694212:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:10530:x1874407323625984:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:2.0:1787574441.694268:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574441.694298:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83400/0xd18a1efeeddb8112 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b63c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.694385:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8119 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.694689:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8119 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.694705:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8119 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.694720:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8120 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x44ff825f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.694728:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.694734:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.694860:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb8127 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.694893:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb8127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.694901:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb8127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574441.694953:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787574441.694958:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574441.695121:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb8127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695137:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb8127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695146:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8119 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695153:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8119 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695161:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8119 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695169:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574441.695175:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8119 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695184:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8119 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695499:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca5186ca700) 00010000:00010000:2.0:1787574441.695503:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574441.695645:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8119 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695653:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8119 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695670:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695676:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8120 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695682:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8120 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695687:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574441.695690:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8120 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695695:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8120 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695704:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x44ff825f (ffff9ca5186ca100) 00010000:00010000:2.0:1787574441.695707:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574441.695709:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8120 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695715:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8120 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695755:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83400/0xd18a1efeeddb8112 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b63c expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695782:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb8127 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b63c expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574441.695789:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ca5186ca300) 00010000:00010000:2.0:1787574441.695792:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574441.695795:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82000, rc 0) 00000100:00100000:2.0:1787574441.695898:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:10530:x1874407323625984:12345-192.168.202.40@tcp:101:rm.0 Request processed in 1698us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574441.695908:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:2.0:1787574441.718190:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574441.718503:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323626240 00000100:00100000:1.0:1787574441.718519:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323626240 00000100:00100000:1.0:1787574441.718616:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:1.0:1787574441.718630:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:10530:x1874407323626240:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:1.0:1787574441.718701:0:8610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787574441.718747:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb8127 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b63c expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.718773:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb80d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b620 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.718806:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ca5186ca300) 00010000:00010000:1.0:1787574441.718818:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb80e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b627 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.718829:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca5186ca700) 00010000:00010000:1.0:1787574441.718833:0:8610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574441.718860:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb812e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.718876:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb812e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.718887:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb812e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.718897:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x44ff825f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.718904:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.718910:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719037:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb813c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719046:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb813c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719063:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb813c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574441.719690:0:8610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787574441.719704:0:8610:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380902462576ns, next at 381902459745ns, rc = 0 00010000:00010000:1.0:1787574441.719769:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74200/0xd18a1efeeddb8143 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719781:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74200/0xd18a1efeeddb8143 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719790:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74200/0xd18a1efeeddb8143 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719799:0:8610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74200/0xd18a1efeeddb8143 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719805:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74200/0xd18a1efeeddb8143 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719813:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74200/0xd18a1efeeddb8143 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719829:0:8610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574441.719850:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb813c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719856:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb813c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719863:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb813c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719877:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574441.719883:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb813c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719892:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb813c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719905:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ca5186ca300) 00010000:00010000:1.0:1787574441.719907:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787574441.719911:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb813c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.719918:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb813c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.720087:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb812e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.720094:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb812e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.720100:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb812e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.720106:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574441.720109:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb812e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.720115:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb812e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.720134:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca5186ca700) 00010000:00010000:1.0:1787574441.720137:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574441.720140:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb812e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.720146:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb812e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574441.720156:0:8610:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d6bb321 reply state 000000000ae6b3f1 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.720169:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574441.720176:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x44ff825f (ffff9ca5186ca100) 00010000:00010000:1.0:1787574441.720179:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787574441.720183:0:8610:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787574441.720328:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:10530:x1874407323626240:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1697us (2152us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787574441.720339:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00010000:00010000:0.0:1787574441.720433:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574441.720441:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74200/0xd18a1efeeddb8143 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.720449:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574441.720453:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74200/0xd18a1efeeddb8143 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.720461:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74200/0xd18a1efeeddb8143 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.720471:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ca5186ca300) 00010000:00010000:0.0:1787574441.720474:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787574441.720477:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74200/0xd18a1efeeddb8143 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.720494:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74200/0xd18a1efeeddb8143 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.720507:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574441.720508:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574441.720510:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574441.727502:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574441.727605:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323626496 00000100:00100000:0.0:1787574441.727619:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323626496 00000100:00100000:0.0:1787574441.727698:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1787574441.727710:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:10530:x1874407323626496:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1787574441.728124:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:10530:x1874407323626496:12345-192.168.202.40@tcp:35:rm.0 Request processed in 415us (637us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787574441.728132:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1787574441.730824:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574441.731166:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323626752 00000100:00100000:0.0:1787574441.731190:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323626752 00000100:00100000:0.0:1787574441.731408:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1787574441.731422:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:10530:x1874407323626752:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:0.0:1787574441.731627:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787574441.731666:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8104 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b635 expref: 19 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.731695:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb80a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b612 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.731709:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca5186ca700) 00010000:00010000:0.0:1787574441.731728:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82400/0xd18a1efeeddb8063 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b604 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.731758:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca5186ca900) 00010000:00010000:0.0:1787574441.731766:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574441.731796:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb814a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.731811:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb814a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.731821:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb814a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.731834:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.731841:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.731848:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.735631:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8158 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.735662:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8158 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.735680:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8158 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574441.737792:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787574441.737828:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8158 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.737862:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8158 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.737871:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8158 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.737877:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574441.737885:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8158 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.737893:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8158 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.737913:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ca534a50e00) 00010000:00010000:0.0:1787574441.737917:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787574441.737922:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8158 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.741725:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8158 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.741800:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb814a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.741808:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb814a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.741818:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb814a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.741824:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574441.741851:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb814a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.741859:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb814a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.741880:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a50400) 00010000:00010000:0.0:1787574441.741883:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574441.741888:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb814a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.741895:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb814a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574441.741909:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055bac195 reply state 0000000053a46264 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.741922:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574441.741940:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ca534a50600) 00010000:00010000:0.0:1787574441.741943:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574441.741947:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574441.742098:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:10530:x1874407323626752:12345-192.168.202.40@tcp:36:rm.0 Request processed in 10672us (11281us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787574441.742108:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00010000:00010000:0.0:1787574442.673510:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574443.697521:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574443.761413:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574443.761442:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346787968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574443.761535:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574443.761636:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346787968 00000100:00100000:2.0:1787574443.761647:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346787968 00000100:00100000:2.0:1787574443.761725:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787574443.761737:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346787968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574443.761774:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574443.761829:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346787968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574443.761838:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:2.0:1787574443.761886:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d50000 x1874407346787968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574443.761913:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346787968:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787574443.761956:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787574443.773497:0:8616:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382956252037ns, next at 383956248786ns, rc = 0 00000100:00100000:2.0:1787574443.773605:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346788096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574443.773709:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574443.774110:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346788096 00000100:00100000:1.0:1787574443.774120:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346788096 00000100:00100000:1.0:1787574443.774221:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787574443.774232:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346788096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574443.774282:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574443.774340:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346788096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574443.774356:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:1.0:1787574443.774403:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403594e00 x1874407346788096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574443.774425:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346788096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787574443.774533:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787574444.721420:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574445.300637:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574445.300676:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346788224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574445.300783:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574445.301107:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346788224 00000100:00100000:0.0:1787574445.301118:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346788224 00000100:00100000:0.0:1787574445.301237:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787574445.301281:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346788224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574445.301327:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574445.301401:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346788224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574445.301409:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787574445.301526:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346788224:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787574445.763438:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574445.809509:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346788352:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.809596:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.809642:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346788864:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.809670:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.809689:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346789376:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.809715:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.809740:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787574445.809746:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346788736:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.809772:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.809788:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346789248:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.809807:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.809824:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346789760:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.809845:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.809875:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346788608:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.809900:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.809920:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346789120:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.809941:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.809958:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346789632:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.809992:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.810012:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787574445.810018:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40349dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346788480:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810055:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.810073:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346788992:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810093:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.810110:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346789504:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810131:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574445.810154:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346788352 00000100:00100000:3.0:1787574445.810162:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346788352 00000100:00100000:3.0:1787574445.810208:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787574445.810217:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346788352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810288:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346788352:12345-0@lo:400:kworker.0 Request processed in 72us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.810295:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787574445.810327:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346788864 00000100:00100000:3.0:1787574445.810331:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346788864 00000100:00100000:3.0:1787574445.810357:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346789376 00000100:00100000:3.0:1787574445.810360:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346789376 00000100:00100000:3.0:1787574445.810371:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346788608 00000100:00100000:3.0:1787574445.810374:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346788608 00000100:00100000:3.0:1787574445.810384:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346788480 00000100:00100000:3.0:1787574445.810387:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346788480 00000100:00100000:3.0:1787574445.810396:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346788992 00000100:00100000:3.0:1787574445.810398:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346788992 00000100:00100000:3.0:1787574445.810409:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346789504 00000100:00100000:3.0:1787574445.810411:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346789504 00000100:00100000:3.0:1787574445.810423:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787574445.810429:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346788864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810468:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346788864:12345-0@lo:400:kworker.0 Request processed in 40us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.810474:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787574445.810487:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787574445.810493:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346789376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810516:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346789376:12345-0@lo:400:kworker.0 Request processed in 24us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.810522:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787574445.810531:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787574445.810536:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346788608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810576:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346788608:12345-0@lo:400:kworker.0 Request processed in 39us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.810582:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787574445.810594:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787574445.810601:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346788480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810627:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346788480:12345-0@lo:400:kworker.0 Request processed in 27us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.810631:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787574445.810642:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787574445.810648:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346788992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810671:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346788992:12345-0@lo:400:kworker.0 Request processed in 23us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.810676:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787574445.810684:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787574445.810689:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346789504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810720:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346789504:12345-0@lo:400:kworker.0 Request processed in 31us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.810725:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787574445.810744:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346788736 00000100:00100000:3.0:1787574445.810748:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346788736 00000100:00100000:3.0:1787574445.810778:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787574445.810784:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346788736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810812:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346788736:12345-0@lo:400:kworker.0 Request processed in 29us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.810817:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787574445.810833:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346789248 00000100:00100000:3.0:1787574445.810836:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346789248 00000100:00100000:3.0:1787574445.810853:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346789760 00000100:00100000:3.0:1787574445.810856:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346789760 00000100:00100000:3.0:1787574445.810866:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346789120 00000100:00100000:3.0:1787574445.810868:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346789120 00000100:00100000:3.0:1787574445.810878:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346789632 00000100:00100000:3.0:1787574445.810880:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346789632 00000100:00100000:3.0:1787574445.810891:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787574445.810896:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346789248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810940:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346789248:12345-0@lo:400:kworker.0 Request processed in 43us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.810946:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787574445.810956:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787574445.810962:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346789760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.810986:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346789760:12345-0@lo:400:kworker.0 Request processed in 25us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.810991:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787574445.811009:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787574445.811015:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346789120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.811041:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346789120:12345-0@lo:400:kworker.0 Request processed in 27us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.811046:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787574445.811057:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787574445.811062:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346789632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.811086:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346789632:12345-0@lo:400:kworker.0 Request processed in 23us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.811091:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787574445.811138:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346788480:0@lo:400:kworker.0 00010000:00080000:3.0:1787574445.811152:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4019ec380 x1874407346788992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574445.811162:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346788992:0@lo:400:kworker.0 00010000:00080000:3.0:1787574445.811171:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4019eea00 x1874407346789504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574445.811180:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346789504:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.811192:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346788608:0@lo:400:kworker.0 00010000:00080000:3.0:1787574445.811201:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4019ef480 x1874407346789120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574445.811209:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346789120:0@lo:400:kworker.0 00010000:00080000:3.0:1787574445.811218:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40242e300 x1874407346789632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574445.811264:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346789632:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.811309:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346788736:0@lo:400:kworker.0 00010000:00080000:3.0:1787574445.811319:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4019efb80 x1874407346789248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574445.811326:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346789248:0@lo:400:kworker.0 00010000:00080000:3.0:1787574445.811335:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40242c000 x1874407346789760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574445.811343:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346789760:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.811351:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40349c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346788352:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.811360:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346788864:0@lo:400:kworker.0 00000100:00100000:3.0:1787574445.811369:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346789376:0@lo:400:kworker.0 00000100:00100000:1.0:1787574445.811511:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574445.811522:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346789888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574445.811564:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574445.811594:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346789888 00000100:00100000:1.0:1787574445.811598:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346789888 00000100:00100000:1.0:1787574445.811624:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787574445.811630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346789888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574445.811655:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574445.811690:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346789888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574445.811696:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787574445.811725:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346789888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574445.811858:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574445.811867:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346790016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574445.811895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574445.811920:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346790016 00000100:00100000:2.0:1787574445.811924:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346790016 00000100:00100000:2.0:1787574445.811950:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787574445.811956:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346790016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574445.811973:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574445.812005:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346790016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574445.812010:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:2.0:1787574445.812036:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d52a00 x1874407346790016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574445.812049:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346790016:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787574445.812105:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574445.812110:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574445.812113:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574445.812115:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574445.822602:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346790144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574445.822677:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574445.822761:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346790144 00000100:00100000:2.0:1787574445.822770:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346790144 00000100:00100000:2.0:1787574445.822824:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787574445.822834:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346790144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574445.822857:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574445.822904:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346790144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574445.822910:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:2.0:1787574445.822959:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d52a00 x1874407346790144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574445.822977:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346790144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574445.852684:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574445.859048:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574445.859132:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574445.859155:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574445.859370:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574445.859391:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574445.859423:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323627008 00000100:00100000:3.0:1787574445.859433:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323627008 00000100:00100000:3.0:1787574445.859690:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323627520 00000100:00100000:3.0:1787574445.859695:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323627520 00000100:00100000:3.0:1787574445.859728:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323627136 00000100:00100000:3.0:1787574445.859731:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323627136 00000100:00100000:3.0:1787574445.859745:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323627392 00000100:00100000:3.0:1787574445.859747:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323627392 00000100:00100000:3.0:1787574445.859762:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 269 00000100:00100000:3.0:1787574445.859771:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:2404:x1874407323627008:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574445.859854:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:2404:x1874407323627008:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 83us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.859861:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 269 00000100:00100000:3.0:1787574445.859878:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 270 00000100:00100000:3.0:1787574445.859884:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323627520:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574445.859909:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323627520:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.859915:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 270 00000100:00100000:3.0:1787574445.859926:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 271 00000100:00100000:3.0:1787574445.859932:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323627136:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574445.859954:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323627136:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.859959:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 271 00000100:00100000:3.0:1787574445.859969:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 272 00000100:00100000:3.0:1787574445.859975:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323627392:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574445.859995:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323627392:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.860001:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 272 00000100:00100000:3.0:1787574445.860018:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323627264 00000100:00100000:3.0:1787574445.860029:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323627264 00000100:00100000:3.0:1787574445.860057:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:3.0:1787574445.860064:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323627264:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574445.862413:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323627264:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 2338us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574445.862427:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00080000:3.0:1787574445.862484:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574445.862490:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574445.862493:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574445.862845:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323626880 00000100:00100000:1.0:1787574445.862853:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323626880 00000100:00100000:1.0:1787574445.862894:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 348 00000100:00100000:1.0:1787574445.862902:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323626880:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574445.862937:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323626880:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (10264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574445.862944:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 348 00010000:00010000:0.0:1787574446.770779:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574447.571184:0:13680:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1787574447.793403:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787574447.861457:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787574447.861546:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1787574447.861557:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1787574447.861610:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861623:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861632:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861637:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574447.861642:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861650:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861671:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x44ff825f (ffff9ca5186ca100) 00010000:00010000:3.0:1787574447.861675:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574447.861679:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861702:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb80b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861722:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861729:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861735:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861740:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574447.861743:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861749:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861758:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ca5186ca300) 00010000:00010000:3.0:1787574447.861760:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574447.861763:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861769:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99800/0xd18a1efeeddb80cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861784:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861791:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861803:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861808:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574447.861811:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861817:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861825:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x44ff825f (ffff9ca5186ca100) 00010000:00010000:3.0:1787574447.861827:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574447.861830:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861835:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb8135 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x44ff825f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861858:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861865:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861870:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861883:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574447.861886:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861901:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861910:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ca534a50600) 00010000:00010000:3.0:1787574447.861912:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574447.861916:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.861922:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb8151 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574447.862718:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346790272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787574447.862791:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574447.863788:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346790272 00000100:00100000:3.0:1787574447.863798:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346790272 00000100:00100000:3.0:1787574447.864047:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787574447.864059:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346790272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787574447.864088:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1787574447.864121:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8c38a9, atime: 0x6a8c38a9, ctime: 0x6a8c38a9, blocks: 0x0 00010000:00010000:3.0:1787574447.864128:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdcaed32/0xd18a1efeeddb815f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.864359:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1787574447.864365:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574447.864372:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdcaed32/0xd18a1efeeddb815f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.864389:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdcaed32/0xd18a1efeeddb815f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.864415:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdcaed32/0xd18a1efeeddb815f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.864422:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdcaed32/0xd18a1efeeddb815f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574447.864546:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787574447.864732:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346790272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 675us (1939us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787574447.864740:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1787574447.865055:0:3634:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca403594e00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787574447.865063:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346790272:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1787574447.865278:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787574447.865609:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574447.865616:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdcaed32/0xd18a1efeeddb815f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574447.865627:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be98c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574447.865631:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdcaed32/0xd18a1efeeddb815f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574447.865641:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdcaed32/0xd18a1efeeddb815f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574447.865662:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdcaed32/0xd18a1efeeddb815f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574447.865669:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdcaed32/0xd18a1efeeddb815f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574447.865706:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574447.865708:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574447.865709:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787574448.739815:0:13728:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc415d5110 20000000:00000080:2.0:1787574448.739840:0:13728:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ca403660c00 uarg=0000000000000000 20000000:01000000:2.0:1787574448.739969:0:13728:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787574448.739978:0:13728:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787574448.740057:0:13728:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787574448.741175:0:13729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787574448.741616:0:13728:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787574448.746754:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787574448.746793:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787574448.746807:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787574448.746826:0:13728:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787574448.746850:0:13728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.746873:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7ff3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7fec expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.746882:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb8001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb7ffa expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.746890:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb800f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb8008 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.746914:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be75c00/0xd18a1efeeddb801d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb8016 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.746925:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb8024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5ef expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.746932:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca500031e00/0xd18a1efeeddb802b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5f6 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.746940:0:13728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.746993:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca500031e00/0xd18a1efeeddb802b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5f6 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.747010:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca500031e00/0xd18a1efeeddb802b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5f6 expref: 12 pid: 6501 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574448.747026:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346790400:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574448.747165:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb8024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5ef expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.747174:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb8024 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5ef expref: 12 pid: 6501 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574448.747183:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346790528:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574448.747210:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be75c00/0xd18a1efeeddb801d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb8016 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.747228:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be75c00/0xd18a1efeeddb801d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb8016 expref: 23 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574448.747278:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402725f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346790656:0@lo:104: 00000100:00100000:2.0:1787574448.747329:0:13728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574448.747371:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb800f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb8008 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.747379:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb800f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb8008 expref: 23 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574448.747388:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346790784:0@lo:104: 00010000:00010000:2.0:1787574448.747412:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb8001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7ffa expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.747420:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb8001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7ffa expref: 23 pid: 6504 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574448.747427:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346790912:0@lo:104: 00010000:00010000:2.0:1787574448.747444:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7ff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb7fec expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.747451:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7ff3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb7fec expref: 23 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574448.747458:0:13728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346791040:0@lo:104: 00000100:00100000:3.0:1787574448.748265:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787574448.748299:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574448.748327:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574448.748340:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346790656 00000100:00100000:3.0:1787574448.748348:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346790656 00000100:00100000:3.0:1787574448.748399:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346790784 00000100:00100000:3.0:1787574448.748402:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346790784 00000100:00100000:3.0:1787574448.748412:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346790912 00000100:00100000:3.0:1787574448.748415:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346790912 00000100:00100000:3.0:1787574448.748429:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574448.748439:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403471050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:13728:x1874407346790656:12345-0@lo:104: 00010000:00010000:3.0:1787574448.748457:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.748756:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574448.748764:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403471050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+5:13728:x1874407346790656:12345-0@lo:104: Request processed in 327us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574448.748790:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574448.748840:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574448.748906:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:13728:x1874407346790784:12345-0@lo:104: 00010000:00010000:3.0:1787574448.748915:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.748954:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787574448.748960:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+4:13728:x1874407346790784:12345-0@lo:104: Request processed in 56us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574448.748966:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574448.748980:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574448.748986:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:13728:x1874407346790912:12345-0@lo:104: 00010000:00010000:3.0:1787574448.748993:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.749020:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787574448.749025:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:13728:x1874407346790912:12345-0@lo:104: Request processed in 40us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574448.749031:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1787574448.749801:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787574448.749812:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.749823:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574448.749828:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.749965:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574448.750199:0:13730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574448.750207:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.750215:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030c00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574448.750219:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.750229:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574448.750267:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574448.750275:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574448.750333:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.750340:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574448.750701:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574448.750708:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574448.750714:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787574448.750732:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.750739:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574448.750760:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.750767:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca500030a00/0xd18a1efeeddb8016 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb801d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.750785:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574448.750787:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574448.750789:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574448.751863:0:13728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574448.751926:0:13728:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53525f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787574448.751978:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402725f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346790656:0@lo:104: 00000100:00100000:2.0:1787574448.752000:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346790784:0@lo:104: 00000100:00100000:2.0:1787574448.752010:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346790912:0@lo:104: 00000100:00100000:3.0:1787574448.752647:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346791168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574448.752694:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574448.752746:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346791296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574448.752771:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574448.752813:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346791168 00000100:00100000:3.0:1787574448.752821:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346791168 00000100:00100000:2.0:1787574448.753378:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346790400:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574448.753390:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346790528:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574448.753950:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb800f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb8008 expref: 24 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574448.754028:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346791296 00000100:00100000:3.0:1787574448.754035:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346791296 00010000:00010000:3.0:1787574448.754060:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be75c00/0xd18a1efeeddb801d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb8016 expref: 25 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574448.754084:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787574448.754095:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+25:3635:x1874407346791168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574448.754111:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574448.754118:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb800f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb8008 expref: 25 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.754131:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb800f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb8008 expref: 25 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.754153:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75200/0xd18a1efeeddb800f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb8008 expref: 25 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.754172:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574448.754231:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346791168:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574448.754264:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787574448.754286:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787574448.754293:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:3636:x1874407346791296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574448.754300:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574448.754305:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be75c00/0xd18a1efeeddb801d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb8016 expref: 23 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.754313:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be75c00/0xd18a1efeeddb801d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb8016 expref: 23 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.754331:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75c00/0xd18a1efeeddb801d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb8016 expref: 23 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.754340:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574448.754371:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3636:x1874407346791296:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574448.754378:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1787574448.754703:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.754713:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca500030c00/0xd18a1efeeddb8008 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb800f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.754741:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574448.754743:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574448.754745:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574448.755015:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574448.755023:0:13730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.755031:0:13730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574448.755036:0:13730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.755046:0:13730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574448.755054:0:13730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574448.755060:0:13730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574448.755102:0:13730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.755109:0:13730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574448.755130:0:13730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.755137:0:13730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca500031a00/0xd18a1efeeddb7ffa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb8001 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.755147:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574448.755155:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574448.755157:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574448.755162:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574448.755164:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574448.755400:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346791168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574448.755453:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346791296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574448.755466:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574448.755604:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346791424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574448.755669:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574448.755738:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346791040 00000100:00100000:3.0:1787574448.755745:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346791040 00000100:00100000:3.0:1787574448.755786:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787574448.755795:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:13728:x1874407346791040:12345-0@lo:104: 00010000:00010000:3.0:1787574448.755809:0:6492:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.756070:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574448.756077:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+3:13728:x1874407346791040:12345-0@lo:104: Request processed in 284us (4233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574448.756085:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1787574448.756111:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574448.756116:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.756138:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574448.756143:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.756151:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574448.756159:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574448.756165:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787574448.756192:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.756199:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574448.756214:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.756221:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c11600/0xd18a1efeeddb7fec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb7ff3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.756264:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574448.756267:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574448.756269:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574448.756276:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574448.756286:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346791552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574448.756320:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574448.756348:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346791424 00000100:00100000:3.0:1787574448.756353:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346791424 00010000:00010000:3.0:1787574448.756383:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb8001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7ffa expref: 22 pid: 6504 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574448.756416:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346791552 00000100:00100000:3.0:1787574448.756420:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346791552 00000100:00100000:2.0:1787574448.756677:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787574448.756688:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:3636:x1874407346791424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574448.756702:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574448.756709:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb8001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7ffa expref: 23 pid: 6504 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.756721:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb8001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7ffa expref: 23 pid: 6504 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.756737:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c10200/0xd18a1efeeddb8001 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7ffa expref: 23 pid: 6504 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.756750:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574448.756793:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3636:x1874407346791424:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574448.756800:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787574448.756870:0:13728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1874407346791040:0@lo:104: 00010000:00010000:2.0:1787574448.756918:0:13728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.757634:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7ff3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7fec expref: 21 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574448.757671:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787574448.757684:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:3635:x1874407346791552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574448.757696:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574448.757701:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7ff3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb7fec expref: 21 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.757711:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7ff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb7fec expref: 21 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.757726:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500030800/0xd18a1efeeddb7ff3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb7fec expref: 21 pid: 6501 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574448.757741:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574448.757795:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:3635:x1874407346791552:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574448.757803:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787574448.758061:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346791424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574448.758100:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346791552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574448.762145:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574448.762385:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574448.763796:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323627776 00000100:00100000:3.0:1787574448.763814:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323627776 00010000:00010000:3.0:1787574448.763931:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb8024 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5ef expref: 13 pid: 6501 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574448.764085:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323627648 00000100:00100000:3.0:1787574448.764090:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323627648 00010000:00010000:3.0:1787574448.764107:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca500031e00/0xd18a1efeeddb802b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5f6 expref: 14 pid: 6501 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574448.764149:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1787574448.764176:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403594700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+14:2405:x1874407323627776:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574448.764198:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574448.764206:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb8024 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5ef expref: 14 pid: 6501 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764220:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb8024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5ef expref: 14 pid: 6501 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764270:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb8024 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5ef expref: 14 pid: 6501 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764290:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574448.764366:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403594700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323627776:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 206us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574448.764373:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1787574448.764395:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:0.0:1787574448.764414:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403596680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:2405:x1874407323627648:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574448.764423:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574448.764435:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca500031e00/0xd18a1efeeddb802b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5f6 expref: 12 pid: 6501 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764446:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca500031e00/0xd18a1efeeddb802b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5f6 expref: 12 pid: 6501 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764478:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500031e00/0xd18a1efeeddb802b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5f6 expref: 12 pid: 6501 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764491:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764500:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764528:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764535:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764544:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764551:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764558:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574448.764563:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764572:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764587:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574448.764612:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574448.764634:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403596680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:2405:x1874407323627648:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 233us (2249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574448.764641:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00010000:00010000:2.0:1787574448.764868:0:13728:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.764889:0:13728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574448.764897:0:13728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb8166 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574448.823705:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574448.881929:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574448.883995:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346791808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574448.884098:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574448.884218:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346791808 00000100:00100000:2.0:1787574448.884229:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346791808 00000100:00100000:2.0:1787574448.884321:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787574448.884335:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346791808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574448.884376:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574448.884451:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346791808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574448.885224:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1787574448.885313:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574448.885369:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346791808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574448.887047:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346791680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574448.887139:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574448.890709:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346791680 00000100:00100000:2.0:1787574448.890735:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346791680 00000100:00100000:2.0:1787574448.890866:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787574448.890879:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346791680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574448.890914:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574448.891033:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346791680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (3893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574448.891042:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787574448.891755:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346791680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787574449.842382:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787574449.933030:0:13779:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf16e8be0 20000000:00000080:2.0:1787574449.933050:0:13779:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ca403662800 uarg=0000000000000000 20000000:01000000:2.0:1787574449.933096:0:13779:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787574449.933103:0:13779:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787574449.933108:0:13779:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1787574449.934088:0:13780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1787574449.940027:0:13779:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1787574449.940214:0:13779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1787574449.940426:0:13779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1787574449.940446:0:13779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1787574449.940458:0:13779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787574449.940481:0:13779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb816d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940632:0:13779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb816d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940642:0:13779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb816d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940649:0:13779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb816d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940657:0:13779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb816d lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940665:0:13779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb816d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940673:0:13779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574449.940678:0:13779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb816d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.940703:0:13779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb816d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.941018:0:13779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb816d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.941029:0:13779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb816d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574449.941037:0:13779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb816d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574450.195048:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574450.195169:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323627904 00000100:00100000:3.0:1787574450.195180:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323627904 00000100:00100000:2.0:1787574450.195419:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 349 00000100:00100000:2.0:1787574450.195431:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:6179:x1874407323627904:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574450.195448:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574450.195468:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb8174 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b643 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574450.195535:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb8174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b643 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574450.195546:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb8174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b643 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574450.195555:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82400, rc 0) 00000100:00100000:2.0:1787574450.195660:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323627904:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 230us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574450.195688:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 349 00000100:00100000:2.0:1787574450.197810:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574450.197961:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323628032 00000100:00100000:1.0:1787574450.197970:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323628032 00000100:00100000:1.0:1787574450.198024:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 350 00000100:00100000:1.0:1787574450.198033:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323628032:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.198205:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323628032:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 173us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.198213:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 350 00000100:00100000:3.0:1787574450.200051:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574450.200308:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323628160 00000100:00100000:1.0:1787574450.200316:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323628160 00000100:00100000:1.0:1787574450.200368:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 351 00000100:00100000:1.0:1787574450.200378:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323628160:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.200545:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323628160:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 167us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.200554:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 351 00000100:00100000:3.0:1787574450.204398:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574450.204529:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323628288 00000100:00100000:2.0:1787574450.204539:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323628288 00000100:00100000:2.0:1787574450.204599:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 352 00000100:00100000:2.0:1787574450.204610:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:10814:x1874407323628288:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574450.204760:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:10814:x1874407323628288:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 152us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574450.204769:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 352 00000100:00100000:2.0:1787574450.209092:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574450.209188:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323628416 00000100:00100000:3.0:1787574450.209198:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323628416 00000100:00100000:3.0:1787574450.209285:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 353 00000100:00100000:3.0:1787574450.209296:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:10814:x1874407323628416:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574450.209439:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:10814:x1874407323628416:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 144us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.209447:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 353 00000100:00100000:3.0:1787574450.216753:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574450.217366:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323628544 00000100:00100000:1.0:1787574450.217377:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323628544 00000100:00100000:1.0:1787574450.217441:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 354 00000100:00100000:1.0:1787574450.217452:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:6179:x1874407323628544:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574450.217469:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574450.217498:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb817b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b64a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.217538:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb817b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b64a expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.217550:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb817b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b64a expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.217559:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74800, rc 0) 00000100:00100000:1.0:1787574450.217624:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:6179:x1874407323628544:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 173us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.217631:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 354 00000100:00100000:0.0:1787574450.222751:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574450.222917:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323628672 00000100:00100000:2.0:1787574450.222928:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323628672 00000100:00100000:2.0:1787574450.222996:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 355 00000100:00100000:2.0:1787574450.223008:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:6179:x1874407323628672:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.224489:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:6179:x1874407323628672:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 1475us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574450.224513:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 355 10000000:01000000:2.0:1787574450.225988:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787574450.225994:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53bf11000 from 7 10000000:01000000:2.0:1787574450.225999:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574450.226057:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574450.226070:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574450.226081:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574450.226120:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346791936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.226196:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.226277:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574450.226614:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346791936 00000100:00100000:1.0:1787574450.226621:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346791936 00000100:00100000:1.0:1787574450.226679:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787574450.226689:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:6506:x1874407346791936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574450.226702:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574450.226717:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb8189 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb8182 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.226740:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb8189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb8182 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.226750:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb8189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb8182 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.226758:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75800, rc 0) 00000100:00100000:1.0:1787574450.226821:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346791936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.226835:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787574450.227046:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346791936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574450.227063:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574450.227073:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574450.227139:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346792064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574450.227177:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574450.227204:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574450.227592:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346792064 00000100:00100000:1.0:1787574450.227597:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346792064 00000100:00100000:1.0:1787574450.227632:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787574450.227639:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346792064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.227758:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346792064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.227765:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787574450.227801:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346792064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.227827:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346792192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.227863:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.227881:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574450.227890:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346792192 00000100:00100000:1.0:1787574450.227893:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346792192 00000100:00100000:1.0:1787574450.227906:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787574450.227911:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346792192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.227974:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346792192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.227980:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787574450.228024:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346792192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.228205:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13792:1874407346792320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574450.228236:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.228278:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346792320 00000100:00100000:1.0:1787574450.228281:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346792320 00000100:00100000:1.0:1787574450.228306:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787574450.228312:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:13792:x1874407346792320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574450.228374:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:13792:x1874407346792320:12345-0@lo:502:llog_process_th.0 Request processed in 61us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.228380:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787574450.228407:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574450.228428:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13792:1874407346792320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574450.228446:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574450.228454:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574450.228456:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574450.228466:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca53bf11000 00000020:00000080:1.0:1787574450.228469:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574450.228526:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574450.228530:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574450.228532:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574450.228535:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574450.228537:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574450.228538:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787574450.228541:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca53bf11000 00000020:00000080:1.0:1787574450.228543:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787574450.228574:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13792:1874407346792448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574450.228610:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.228629:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346792448 00000100:00100000:1.0:1787574450.228633:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346792448 00000100:00100000:1.0:1787574450.228648:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787574450.228654:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:13792:x1874407346792448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574450.228707:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:13792:x1874407346792448:12345-0@lo:502:llog_process_th.0 Request processed in 52us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.228721:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787574450.228743:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574450.228753:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13792:1874407346792448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574450.228767:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574450.228770:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574450.228772:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787574450.228776:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787574450.228821:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787574450.228838:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574450.228846:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.228856:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574450.228866:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787574450.228869:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53bc3a000 from 7 10000000:01000000:1.0:1787574450.228871:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574450.228895:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.228903:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.228911:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574450.228922:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346792576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.228944:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.228961:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574450.228977:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346792576 00000100:00100000:1.0:1787574450.228980:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346792576 00000100:00100000:1.0:1787574450.228994:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1787574450.228999:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+21:6506:x1874407346792576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574450.229006:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574450.229016:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb8197 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb8190 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.229032:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb8197 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb8190 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.229041:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb8197 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb8190 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.229050:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75600, rc 0) 00000100:00100000:1.0:1787574450.229072:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346792576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.229077:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1787574450.229099:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346792576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574450.229109:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.229117:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574450.229154:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346792704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.229177:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.229198:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574450.229209:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346792704 00000100:00100000:1.0:1787574450.229213:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346792704 00000100:00100000:1.0:1787574450.229229:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787574450.229235:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346792704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.229325:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346792704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.229330:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787574450.229357:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346792704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.229379:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346792832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.229414:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.229433:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574450.229443:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346792832 00000100:00100000:1.0:1787574450.229446:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346792832 00000100:00100000:1.0:1787574450.229463:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787574450.229467:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346792832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.229543:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346792832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.229549:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787574450.229581:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346792832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.229758:0:13793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13793:1874407346792960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574450.229792:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.229810:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346792960 00000100:00100000:1.0:1787574450.229814:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346792960 00000100:00100000:1.0:1787574450.229831:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787574450.229837:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:13793:x1874407346792960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574450.229904:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:13793:x1874407346792960:12345-0@lo:502:llog_process_th.0 Request processed in 66us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.229910:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787574450.229933:0:13793:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787574450.229943:0:13793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13793:1874407346792960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574450.229958:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574450.229964:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574450.229966:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574450.229972:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca53bc3a000 00000020:00000080:1.0:1787574450.229975:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574450.230005:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574450.230007:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574450.230009:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574450.230011:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574450.230013:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574450.230015:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787574450.230018:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca53bc3a000 00000020:00000080:1.0:1787574450.230019:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787574450.230044:0:13793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13793:1874407346793088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574450.230071:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.230086:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346793088 00000100:00100000:1.0:1787574450.230089:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346793088 00000100:00100000:1.0:1787574450.230102:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787574450.230107:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:13793:x1874407346793088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574450.230159:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:13793:x1874407346793088:12345-0@lo:502:llog_process_th.0 Request processed in 50us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.230165:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787574450.230196:0:13793:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787574450.230207:0:13793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13793:1874407346793088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574450.230224:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574450.230228:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574450.230230:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787574450.230233:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787574450.230303:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787574450.230319:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574450.230325:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.230334:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574450.230343:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787574450.230345:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca526758000 from 7 10000000:01000000:1.0:1787574450.230347:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574450.230364:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.230371:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.230379:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574450.230392:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346793216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.230416:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.230435:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53525f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574450.230446:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346793216 00000100:00100000:1.0:1787574450.230455:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346793216 00000100:00100000:1.0:1787574450.230474:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787574450.230480:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:6506:x1874407346793216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574450.230487:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574450.230496:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb81a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb819e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.238134:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb81a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb819e expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.238152:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb81a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb819e expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574450.238162:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74c00, rc 0) 00000100:00100000:1.0:1787574450.238324:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346793216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 7841us (7904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.238334:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787574450.242393:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346793216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574450.242424:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574450.242437:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574450.242622:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346793344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574450.242684:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.242728:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53525fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574450.243728:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346793344 00000100:00100000:2.0:1787574450.243739:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346793344 00000100:00100000:2.0:1787574450.243833:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787574450.243843:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346793344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.243993:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346793344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574450.244002:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787574450.244067:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346793344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.244105:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346793472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.244147:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.244171:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574450.244185:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346793472 00000100:00100000:2.0:1787574450.244189:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346793472 00000100:00100000:2.0:1787574450.244215:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787574450.244221:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346793472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.244316:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346793472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574450.244322:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787574450.244358:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346793472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.244534:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13796:1874407346793600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574450.245154:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.245180:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646480 going to sleep for 11 seconds 00000100:00100000:0.0:1787574450.246988:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346793600 00000100:00100000:0.0:1787574450.247001:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346793600 00000100:00100000:0.0:1787574450.247067:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787574450.247077:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:13796:x1874407346793600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574450.247637:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:13796:x1874407346793600:12345-0@lo:502:llog_process_th.0 Request processed in 559us (2482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574450.247654:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1787574450.247771:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13796:1874407346793600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574450.247811:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574450.247822:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574450.247824:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787574450.247831:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca526758000 00000020:00000080:3.0:1787574450.247834:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787574450.247894:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574450.247899:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574450.247900:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787574450.247903:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574450.247911:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574450.247912:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787574450.247916:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca526758000 00000020:00000080:3.0:1787574450.247919:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787574450.247966:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13796:1874407346793728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574450.248010:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574450.248052:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346793728 00000100:00100000:3.0:1787574450.248057:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346793728 00000100:00100000:3.0:1787574450.248083:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1787574450.248089:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:13796:x1874407346793728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574450.248158:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:13796:x1874407346793728:12345-0@lo:502:llog_process_th.0 Request processed in 68us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.248165:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1787574450.248202:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bc28f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574450.248215:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13796:1874407346793728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787574450.248232:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574450.248236:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574450.248263:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787574450.248267:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787574450.248972:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787574450.248999:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787574450.249009:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574450.249022:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574450.249152:0:6506:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787574450.249156:0:6506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca5109bd800 from 7 10000000:01000000:2.0:1787574450.249159:0:6506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574450.249192:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574450.249202:0:6506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574450.249212:0:6506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574450.249228:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346793856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.249316:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.249343:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574450.251146:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346793856 00000100:00100000:3.0:1787574450.251157:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346793856 00000100:00100000:3.0:1787574450.251210:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787574450.251220:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:6506:x1874407346793856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574450.251233:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574450.251269:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb81b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb81ac expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574450.251298:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb81b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb81ac expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574450.251321:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb81b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb81ac expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574450.251330:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99800, rc 0) 00000100:00100000:3.0:1787574450.251394:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346793856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.251401:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787574450.251836:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574450.251882:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346793856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574450.251900:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574450.251911:0:6506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574450.251983:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346793984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.252014:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574450.252184:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323628800 00000100:00100000:3.0:1787574450.252189:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323628800 00000100:00100000:3.0:1787574450.252209:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346793984 00000100:00100000:3.0:1787574450.252212:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346793984 00000100:00100000:3.0:1787574450.252224:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 372 00000100:00100000:3.0:1787574450.252230:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:6179:x1874407323628800:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574450.252366:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:6179:x1874407323628800:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 134us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.252374:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 372 00000100:00100000:3.0:1787574450.252393:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787574450.252400:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346793984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574450.252488:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346793984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.252495:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1787574450.252670:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574450.252685:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346793984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.252713:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346794112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.252747:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.252767:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646480 going to sleep for 11 seconds 00000100:00100000:0.0:1787574450.253100:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346794112 00000100:00100000:0.0:1787574450.253106:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346794112 00000100:00100000:0.0:1787574450.253134:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787574450.253141:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346794112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574450.253216:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:6506:x1874407346794112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574450.253223:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1787574450.253357:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:6506:1874407346794112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574450.254446:0:13797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13797:1874407346794240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574450.254860:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.254901:0:13797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574450.255015:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346794240 00000100:00100000:0.0:1787574450.255021:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346794240 00000100:00100000:0.0:1787574450.255056:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787574450.255065:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:13797:x1874407346794240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574450.255184:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:13797:x1874407346794240:12345-0@lo:502:llog_process_th.0 Request processed in 118us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574450.255192:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1787574450.255470:0:13797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13797:1874407346794240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574450.255498:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574450.255519:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574450.255527:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787574450.255534:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca5109bd800 00000020:00000080:2.0:1787574450.255536:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787574450.255586:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574450.255590:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574450.255592:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787574450.255595:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574450.255597:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574450.255599:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787574450.255602:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca5109bd800 00000020:00000080:2.0:1787574450.255604:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787574450.255643:0:13797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13797:1874407346794368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574450.255758:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.255797:0:13797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c30f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574450.259117:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346794368 00000100:00100000:3.0:1787574450.259132:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346794368 00000100:00100000:3.0:1787574450.259182:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1787574450.259192:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:13797:x1874407346794368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574450.259372:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:13797:x1874407346794368:12345-0@lo:502:llog_process_th.0 Request processed in 181us (3614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.259381:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787574450.259536:0:13797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402690000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:13797:1874407346794368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574450.259573:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574450.259582:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574450.259585:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787574450.259589:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:0.0:1787574450.259921:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574450.260033:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323628928 00000100:00100000:2.0:1787574450.260038:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323628928 00000100:00100000:2.0:1787574450.260073:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 377 00000100:00100000:2.0:1787574450.260081:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52052d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:10817:x1874407323628928:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574450.260166:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52052d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:10817:x1874407323628928:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574450.260174:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 377 00000020:01000000:3.0:1787574450.260554:0:6506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787574450.260577:0:6506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574450.260587:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574450.260597:0:6506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574450.267334:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574450.290011:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574450.290143:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323629056 00000100:00100000:3.0:1787574450.290161:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323629056 00000100:00100000:3.0:1787574450.290226:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 378 00000100:00100000:3.0:1787574450.290236:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:10817:x1874407323629056:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574450.290467:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:10817:x1874407323629056:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 230us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.290475:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 378 00000040:00080000:0.0:1787574450.305562:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787574450.420962:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346794496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574450.421036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.422720:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346794496 00000100:00100000:1.0:1787574450.422732:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346794496 00000100:00100000:1.0:1787574450.422797:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787574450.422808:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346794496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787574450.422846:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787574450.427515:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346794496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4680us (6449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.427540:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787574450.431880:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346794496:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787574450.867943:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574450.930872:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346794624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574450.930955:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.931224:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346794624 00000100:00100000:2.0:1787574450.931232:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346794624 00000100:00100000:2.0:1787574450.931312:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787574450.931323:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346794624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574450.931349:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574450.931392:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346794624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574450.931399:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1787574450.931941:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787574450.931974:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d50380 x1874407346794624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574450.931996:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346794624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574450.932205:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574450.932231:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346794752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574450.932297:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574450.932531:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346794752 00000100:00100000:3.0:1787574450.932537:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346794752 00000100:00100000:3.0:1787574450.932586:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787574450.932594:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346794752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574450.932608:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574450.932646:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346794752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.932652:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787574450.932938:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346794880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574450.932975:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574450.933055:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346794880 00000100:00100000:3.0:1787574450.933060:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346794880 00000100:00100000:3.0:1787574450.933094:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787574450.933101:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346794880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574450.933125:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574450.933161:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346794880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.933168:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787574450.933214:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346794880:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1787574450.933386:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787574450.933419:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4019eea00 x1874407346794752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574450.933434:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4019eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346794752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574450.933919:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346795008:0@lo:400:kworker.0 00000100:00100000:2.0:1787574450.933956:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.933982:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346795520:0@lo:400:kworker.0 00000100:00100000:2.0:1787574450.934006:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.934020:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346796032:0@lo:400:kworker.0 00000100:00100000:2.0:1787574450.934039:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.934054:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787574450.934059:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346795392:0@lo:400:kworker.0 00000100:00100000:2.0:1787574450.934079:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574450.934091:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346795904:0@lo:400:kworker.0 00000100:00100000:2.0:1787574450.934111:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.934263:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346795264:0@lo:400:kworker.0 00000100:00100000:1.0:1787574450.934303:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.934328:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346795776:0@lo:400:kworker.0 00000100:00100000:1.0:1787574450.934348:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.934363:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787574450.934368:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346795136:0@lo:400:kworker.0 00000100:00100000:1.0:1787574450.934397:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.934548:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346795648:0@lo:400:kworker.0 00000100:00100000:1.0:1787574450.934573:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574450.934589:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346796160:0@lo:400:kworker.0 00000100:00100000:1.0:1787574450.934608:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574450.934740:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346795520 00000100:00100000:3.0:1787574450.934747:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346795520 00000100:00100000:3.0:1787574450.934799:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346796032 00000100:00100000:3.0:1787574450.934802:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346796032 00000100:00100000:3.0:1787574450.934814:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346795392 00000100:00100000:3.0:1787574450.934816:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346795392 00000100:00100000:3.0:1787574450.934825:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346795136 00000100:00100000:3.0:1787574450.934827:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346795136 00000100:00100000:3.0:1787574450.934836:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346795648 00000100:00100000:3.0:1787574450.934838:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346795648 00000100:00100000:3.0:1787574450.934848:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346796160 00000100:00100000:3.0:1787574450.934850:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346796160 00000100:00100000:3.0:1787574450.934863:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787574450.934871:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346795520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574450.934917:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346795520:12345-0@lo:400:kworker.0 Request processed in 46us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.934924:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787574450.934939:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787574450.934945:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346796032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574450.934969:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346796032:12345-0@lo:400:kworker.0 Request processed in 24us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.934983:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787574450.934995:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787574450.935000:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346795392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574450.935025:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346795392:12345-0@lo:400:kworker.0 Request processed in 25us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.935031:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787574450.935041:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787574450.935046:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346795136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574450.935070:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346795136:12345-0@lo:400:kworker.0 Request processed in 24us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.935076:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787574450.935086:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787574450.935091:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346795648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574450.935114:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346795648:12345-0@lo:400:kworker.0 Request processed in 23us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.935120:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787574450.935129:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787574450.935134:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346796160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574450.935169:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346796160:12345-0@lo:400:kworker.0 Request processed in 33us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.935175:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787574450.935213:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346795904 00000100:00100000:3.0:1787574450.935217:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346795904 00000100:00100000:3.0:1787574450.935265:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346795776 00000100:00100000:3.0:1787574450.935268:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346795776 00000100:00080000:1.0:1787574450.935695:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574450.935700:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574450.935702:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574450.935732:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346795136:0@lo:400:kworker.0 00010000:00080000:1.0:1787574450.935745:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4f5c00 x1874407346795648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574450.935757:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346795648:0@lo:400:kworker.0 00010000:00080000:1.0:1787574450.935765:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4f4e00 x1874407346796160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574450.935782:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346796160:0@lo:400:kworker.0 00000100:00100000:1.0:1787574450.935844:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787574450.935852:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346795904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574450.935891:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346795904:12345-0@lo:400:kworker.0 Request processed in 41us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574450.935897:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787574450.936385:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346795264 00000100:00100000:2.0:1787574450.936390:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346795264 00000100:00100000:0.0:1787574450.936528:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346795008 00000100:00100000:0.0:1787574450.936533:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346795008 00000100:00100000:0.0:1787574450.936576:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787574450.936583:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346795008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574450.936624:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346795008:12345-0@lo:400:kworker.0 Request processed in 41us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574450.936644:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787574450.936714:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346795392:0@lo:400:kworker.0 00000100:00100000:0.0:1787574450.936729:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346795904:0@lo:400:kworker.0 00000100:00100000:0.0:1787574450.936740:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346795008:0@lo:400:kworker.0 00000100:00100000:0.0:1787574450.936751:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346795520:0@lo:400:kworker.0 00000100:00100000:0.0:1787574450.936762:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346796032:0@lo:400:kworker.0 00000100:00100000:3.0:1787574450.937639:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787574450.937647:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346795776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574450.937714:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346795776:12345-0@lo:400:kworker.0 Request processed in 67us (3364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.937721:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787574450.937761:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346795776:0@lo:400:kworker.0 00000100:00100000:2.0:1787574450.937896:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787574450.937905:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346795264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574450.937953:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346795264:12345-0@lo:400:kworker.0 Request processed in 50us (3649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574450.937972:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1787574450.938997:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574450.939551:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346795264:0@lo:400:kworker.0 00000100:00100000:2.0:1787574450.955587:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574450.955635:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574450.955653:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574450.955672:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574450.955691:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574450.955714:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574450.955741:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323629440 00000100:00100000:2.0:1787574450.955749:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323629440 00000100:00100000:2.0:1787574450.955800:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323629696 00000100:00100000:2.0:1787574450.955803:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323629696 00000100:00100000:2.0:1787574450.955814:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323629312 00000100:00100000:2.0:1787574450.955817:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323629312 00000100:00100000:3.0:1787574450.955928:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323629184 00000100:00100000:3.0:1787574450.955933:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323629184 00000100:00100000:3.0:1787574450.955964:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 380 00000100:00100000:3.0:1787574450.955974:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323629184:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574450.956051:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323629184:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 78us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574450.956059:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 380 00000100:00100000:0.0:1787574450.957545:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323629824 00000100:00100000:0.0:1787574450.957556:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323629824 00000100:00100000:0.0:1787574450.957605:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 279 00000100:00100000:0.0:1787574450.957614:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323629440:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574450.957675:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323629440:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 61us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574450.957698:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 279 00000100:00100000:0.0:1787574450.957715:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 280 00000100:00100000:0.0:1787574450.957722:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323629696:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574450.957749:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323629696:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574450.957756:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 280 00000100:00100000:0.0:1787574450.957766:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 281 00000100:00100000:0.0:1787574450.957772:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323629824:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574450.957795:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323629824:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574450.957802:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 281 00000100:00100000:2.0:1787574450.958842:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 282 00000100:00100000:2.0:1787574450.958855:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323629312:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574450.958895:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323629312:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 44us (3222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574450.958901:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 282 00000100:00100000:2.0:1787574450.958930:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323629568 00000100:00100000:2.0:1787574450.958935:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323629568 00000100:00100000:2.0:1787574450.958964:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 110 00000100:00100000:2.0:1787574450.958970:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323629568:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574450.958995:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323629568:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (3303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574450.959001:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 110 00000100:00080000:2.0:1787574450.959015:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574450.959029:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574450.959046:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1787574451.314027:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787574451.314310:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787574451.891867:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574452.913539:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574453.937433:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574454.001543:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346796288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574454.001617:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574454.001674:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346796288 00000100:00100000:0.0:1787574454.001684:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346796288 00000100:00080000:1.0:1787574454.001729:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574454.001840:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787574454.001854:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346796288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574454.001886:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574454.001935:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346796288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574454.001938:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346796416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574454.001943:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787574454.001967:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574454.002002:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346796288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574454.002096:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346796416 00000100:00100000:3.0:1787574454.002101:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346796416 00000100:00100000:3.0:1787574454.002131:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1787574454.002137:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574454.002138:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346796416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574454.002149:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574454.002185:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346796416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574454.002191:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787574454.002206:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346796416:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1787574454.005914:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1787574454.961509:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574455.537612:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346796544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574455.537701:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574455.538269:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346796544 00000100:00100000:3.0:1787574455.538279:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346796544 00000100:00100000:3.0:1787574455.538338:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787574455.538361:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346796544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574455.538394:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787574455.538574:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346796544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574455.538582:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787574455.538742:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346796544:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787574455.989545:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574456.049654:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574456.049678:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40345e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346796672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574456.049763:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574456.050544:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346796672 00000100:00100000:3.0:1787574456.050553:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346796672 00000100:00100000:3.0:1787574456.050623:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787574456.050633:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346796672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574456.050665:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574456.050726:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346796672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574456.050734:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787574456.051519:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346797056:0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.051574:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574456.051608:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346797568:0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.051632:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574456.051651:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346798080:0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.051669:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574456.051694:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787574456.051699:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346796928:0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.051723:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574456.051751:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346797440:0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.051771:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574456.051785:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346797952:0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.051802:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574456.051826:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346797056 00000100:00100000:0.0:1787574456.051831:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346797056 00000100:00100000:0.0:1787574456.051860:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787574456.051867:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346797056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.051909:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346797056:12345-0@lo:400:kworker.0 Request processed in 43us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574456.051917:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787574456.051936:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346797568 00000100:00100000:0.0:1787574456.051940:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346797568 00000100:00100000:0.0:1787574456.051965:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346798080 00000100:00100000:0.0:1787574456.051968:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346798080 00000100:00100000:0.0:1787574456.051985:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787574456.051991:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346797568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.052020:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346797568:12345-0@lo:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574456.052032:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787574456.052045:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787574456.052051:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346798080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.052078:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346798080:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574456.052083:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787574456.052103:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346796928 00000100:00100000:0.0:1787574456.052106:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346796928 00000100:00100000:0.0:1787574456.052128:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346797440 00000100:00100000:0.0:1787574456.052130:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346797440 00000100:00100000:0.0:1787574456.052146:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346797952 00000100:00100000:0.0:1787574456.052149:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346797952 00000100:00100000:0.0:1787574456.052162:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787574456.052167:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346796928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.052196:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346796928:12345-0@lo:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574456.052203:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787574456.052214:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787574456.052234:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346797440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.052293:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346797440:12345-0@lo:400:kworker.0 Request processed in 73us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574456.052299:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787574456.052310:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787574456.052316:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346797952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.052341:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346797952:12345-0@lo:400:kworker.0 Request processed in 26us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574456.052357:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787574456.052727:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346797184:0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.052772:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574456.052793:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346797696:0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.052814:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574456.052830:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346798208:0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.052850:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574456.052870:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787574456.052877:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346796800:0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.052904:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574456.052928:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346797312:0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.052948:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574456.052963:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346797824:0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.052982:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574456.052993:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346798336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574456.053011:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574456.053039:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346796800 00000100:00100000:2.0:1787574456.053043:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346796800 00000100:00100000:2.0:1787574456.053073:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1787574456.053079:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346796800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.053117:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346796800:12345-0@lo:400:kworker.0 Request processed in 38us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574456.053134:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1787574456.053162:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346798336 00000100:00100000:2.0:1787574456.053167:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346798336 00000100:00100000:2.0:1787574456.053190:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787574456.053197:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346798336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574456.053218:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574456.053266:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346798336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574456.053273:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787574456.053287:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346797184 00000100:00100000:2.0:1787574456.053291:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346797184 00000100:00100000:2.0:1787574456.053304:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346797312 00000100:00100000:2.0:1787574456.053307:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346797312 00000100:00100000:2.0:1787574456.053317:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346797824 00000100:00100000:2.0:1787574456.053320:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346797824 00000100:00100000:2.0:1787574456.053331:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787574456.053337:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346797184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.053613:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346797184:12345-0@lo:400:kworker.0 Request processed in 274us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574456.053621:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787574456.053634:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787574456.053641:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346797312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.053671:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346797312:12345-0@lo:400:kworker.0 Request processed in 31us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574456.053677:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787574456.053688:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787574456.053694:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346797824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.053728:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346797824:12345-0@lo:400:kworker.0 Request processed in 34us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574456.053734:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787574456.054076:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40345e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346796672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574456.054120:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346796928:0@lo:400:kworker.0 00010000:00080000:0.0:1787574456.054135:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4b0700 x1874407346797440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574456.054145:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346797440:0@lo:400:kworker.0 00010000:00080000:0.0:1787574456.054158:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4b1c00 x1874407346797952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574456.054166:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346797952:0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.054178:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346797056:0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.054188:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346797568:0@lo:400:kworker.0 00010000:00080000:0.0:1787574456.054199:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4b3480 x1874407346798080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574456.054208:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346798080:0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.054293:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346797696 00000100:00100000:0.0:1787574456.054298:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346797696 00000100:00100000:0.0:1787574456.054331:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346798208 00000100:00100000:0.0:1787574456.054334:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346798208 00000100:00100000:0.0:1787574456.054347:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787574456.054353:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346797696:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787574456.054525:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574456.054529:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574456.054532:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574456.054534:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574456.054543:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574456.054552:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346798464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574456.054616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574456.054650:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346798464 00000100:00100000:1.0:1787574456.054655:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346798464 00000100:00100000:1.0:1787574456.054680:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787574456.054687:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346798464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787574456.054699:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574456.054733:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346798464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574456.054754:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:1.0:1787574456.054784:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d50380 x1874407346798464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574456.054796:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346798464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574456.054823:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787574456.054831:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346798208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574456.054860:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346798208:12345-0@lo:400:kworker.0 Request processed in 31us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574456.054866:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787574456.055088:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346796800:0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.055102:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346797312:0@lo:400:kworker.0 00000100:00100000:2.0:1787574456.055111:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346797824:0@lo:400:kworker.0 00010000:00080000:2.0:1787574456.055122:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4f4700 x1874407346798336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574456.055134:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346798336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574456.055145:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346797184:0@lo:400:kworker.0 00010000:00080000:2.0:1787574456.055153:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d52a00 x1874407346798208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574456.055160:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346798208:0@lo:400:kworker.0 00000100:00100000:0.0:1787574456.055505:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346797696:12345-0@lo:400:kworker.0 Request processed in 1151us (2688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574456.055524:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787574456.055591:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1787574456.055596:0:3634:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca403594e00, transno 4294967301 00000100:00100000:2.0:1787574456.055658:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346797696:0@lo:400:kworker.0 00000100:00100000:3.0:1787574456.075593:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574456.075639:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574456.075669:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574456.075699:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574456.075720:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574456.075745:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574456.075773:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323630208 00000100:00100000:3.0:1787574456.075782:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323630208 00000100:00100000:3.0:1787574456.075832:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323630464 00000100:00100000:3.0:1787574456.075836:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323630464 00000100:00100000:3.0:1787574456.075849:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323630080 00000100:00100000:3.0:1787574456.075852:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323630080 00000100:00100000:3.0:1787574456.075862:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323630592 00000100:00100000:3.0:1787574456.075865:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323630592 00000100:00100000:3.0:1787574456.075879:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 289 00000100:00100000:3.0:1787574456.075903:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323630208:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574456.075973:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323630208:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 71us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574456.075980:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 289 00000100:00100000:3.0:1787574456.075997:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 290 00000100:00100000:3.0:1787574456.076003:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323630464:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574456.076027:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323630464:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574456.076034:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 290 00000100:00100000:3.0:1787574456.076045:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 291 00000100:00100000:3.0:1787574456.076051:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323630080:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574456.076073:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323630080:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574456.076078:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 291 00000100:00100000:3.0:1787574456.076089:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 292 00000100:00100000:3.0:1787574456.076095:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323630592:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574456.076115:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323630592:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574456.076121:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 292 00000100:00080000:1.0:1787574456.076357:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574456.076372:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574456.076385:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323630336 00000100:00100000:1.0:1787574456.076389:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323630336 00000100:00100000:1.0:1787574456.076431:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:1.0:1787574456.076438:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323630336:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574456.076476:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323630336:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 39us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574456.076483:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:2.0:1787574456.076612:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323629952 00000100:00100000:2.0:1787574456.076616:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323629952 00000100:00100000:2.0:1787574456.076650:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 382 00000100:00100000:2.0:1787574456.076658:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323629952:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574456.076684:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323629952:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574456.076699:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 382 00000100:00080000:3.0:1787574456.077060:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787574457.010557:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574458.033547:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574459.059707:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574459.121703:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574459.121726:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346798592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574459.121795:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574459.122104:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574459.122128:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346798720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574459.122156:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574459.122234:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346798592 00000100:00100000:0.0:1787574459.122263:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346798592 00000100:00100000:0.0:1787574459.122339:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346798720 00000100:00100000:0.0:1787574459.122343:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346798720 00000100:00100000:0.0:1787574459.122363:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787574459.122372:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346798592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574459.122402:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574459.122462:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346798592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574459.122468:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787574459.122484:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787574459.122502:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346798720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574459.122526:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574459.122567:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346798720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574459.122573:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787574459.123019:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574459.123062:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346798720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574459.123093:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346798592:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787574460.081451:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574460.657909:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346798848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574460.657987:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574460.658116:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346798848 00000100:00100000:1.0:1787574460.658124:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346798848 00000100:00100000:1.0:1787574460.658180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787574460.658190:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346798848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787574460.658222:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787574460.658701:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346798848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 511us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574460.658709:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787574460.658780:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346798848:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574461.107693:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574461.169691:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346798976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574461.169768:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574461.169982:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346798976 00000100:00100000:3.0:1787574461.169990:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346798976 00000100:00100000:3.0:1787574461.170040:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787574461.170048:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346798976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574461.170090:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574461.170140:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346798976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574461.170146:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787574461.170659:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346799104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574461.170709:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574461.170821:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346799104 00000100:00100000:0.0:1787574461.170826:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346799104 00000100:00100000:0.0:1787574461.170880:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787574461.170889:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346799104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574461.170909:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574461.170959:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346799104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574461.170965:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:0.0:1787574461.170999:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5186d1180 x1874407346799104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574461.171017:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346799104:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787574461.171147:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574461.171291:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346798976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574461.171548:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346799232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574461.171579:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574461.171667:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346799232 00000100:00100000:1.0:1787574461.171672:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346799232 00000100:00100000:1.0:1787574461.171726:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787574461.171733:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346799232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787574461.171746:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574461.171783:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346799232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574461.171789:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:1.0:1787574461.171814:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5186d0e00 x1874407346799232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574461.171827:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346799232:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787574461.171930:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574461.172145:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346799360:0@lo:400:kworker.0 00000100:00100000:2.0:1787574461.172178:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574461.172262:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346799360 00000100:00100000:3.0:1787574461.172266:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346799360 00000100:00100000:3.0:1787574461.172303:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1787574461.172326:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346799360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.172464:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346799744:0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.172494:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574461.172523:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346799488:0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.172561:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574461.172581:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574461.172587:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346799616:0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.172608:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574461.172634:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346799744 00000100:00100000:1.0:1787574461.172638:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346799744 00000100:00100000:1.0:1787574461.172665:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346799488 00000100:00100000:1.0:1787574461.172668:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346799488 00000100:00100000:1.0:1787574461.172700:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787574461.172707:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346799744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.172740:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346799744:12345-0@lo:400:kworker.0 Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574461.172745:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787574461.172758:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787574461.172764:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346799488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.172790:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346799488:12345-0@lo:400:kworker.0 Request processed in 26us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574461.172795:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787574461.172817:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346799744:0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.172835:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346799616 00000100:00100000:1.0:1787574461.172838:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346799616 00000100:00100000:1.0:1787574461.172856:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787574461.172861:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346799616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.172888:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346799616:12345-0@lo:400:kworker.0 Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574461.172894:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787574461.172921:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346799616:0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.172929:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346799488:0@lo:400:kworker.0 00000100:00100000:3.0:1787574461.186987:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346799360:12345-0@lo:400:kworker.0 Request processed in 14666us (14797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574461.187002:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1787574461.189492:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346799360:0@lo:400:kworker.0 00000100:00100000:0.0:1787574461.189998:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346800128:0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.190161:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346800256:0@lo:400:kworker.0 00000100:00100000:2.0:1787574461.190218:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346799872:0@lo:400:kworker.0 00000100:00100000:3.0:1787574461.190283:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346800000:0@lo:400:kworker.0 00000100:00100000:0.0:1787574461.190421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574461.195031:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574461.195155:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346800128 00000100:00100000:1.0:1787574461.195164:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346800128 00000100:00100000:1.0:1787574461.195225:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346800256 00000100:00100000:1.0:1787574461.195228:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346800256 00000100:00100000:1.0:1787574461.195432:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787574461.195446:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346800128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.195510:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346800128:12345-0@lo:400:kworker.0 Request processed in 68us (5089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574461.195518:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787574461.195535:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787574461.195542:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346800256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.195576:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346800256:12345-0@lo:400:kworker.0 Request processed in 35us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574461.195582:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787574461.195629:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346800256:0@lo:400:kworker.0 00000100:00080000:1.0:1787574461.195669:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574461.195972:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574461.196012:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346800384:0@lo:400:kworker.0 00000100:00100000:2.0:1787574461.196079:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574461.196116:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346799872 00000100:00100000:2.0:1787574461.196121:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346799872 00000100:00100000:2.0:1787574461.196155:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346800384 00000100:00100000:2.0:1787574461.196158:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346800384 00000100:00100000:2.0:1787574461.196176:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787574461.196183:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346799872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574461.196219:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346799872:12345-0@lo:400:kworker.0 Request processed in 36us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574461.196225:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787574461.196252:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787574461.196259:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346800384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574461.196306:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346800384:12345-0@lo:400:kworker.0 Request processed in 48us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574461.196318:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:2.0:1787574461.196340:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574461.196359:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346799872:0@lo:400:kworker.0 00000100:00100000:2.0:1787574461.196370:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346800384:0@lo:400:kworker.0 00000100:00100000:2.0:1787574461.201725:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574461.201762:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574461.201784:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574461.201803:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574461.201823:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574461.201892:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574461.201920:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323630720 00000100:00100000:2.0:1787574461.201928:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323630720 00000100:00100000:2.0:1787574461.201977:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 384 00000100:00100000:2.0:1787574461.201988:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323630720:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574461.202051:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323630720:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 64us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574461.202071:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 384 00000100:00100000:2.0:1787574461.202102:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323630848 00000100:00100000:2.0:1787574461.202106:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323630848 00000100:00100000:2.0:1787574461.202139:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323630976 00000100:00100000:2.0:1787574461.202143:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323630976 00000100:00100000:2.0:1787574461.202155:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323631232 00000100:00100000:2.0:1787574461.202157:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323631232 00000100:00100000:2.0:1787574461.202168:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323631360 00000100:00100000:2.0:1787574461.202170:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323631360 00000100:00100000:2.0:1787574461.202201:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 297 00000100:00100000:2.0:1787574461.202208:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323630848:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574461.202255:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323630848:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 31us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574461.202262:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 297 00000100:00100000:2.0:1787574461.202286:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 298 00000100:00100000:2.0:1787574461.202292:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323630976:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574461.202318:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323630976:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574461.202324:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 298 00000100:00100000:2.0:1787574461.202335:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 299 00000100:00100000:2.0:1787574461.202341:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323631232:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574461.202362:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323631232:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574461.202368:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 299 00000100:00100000:2.0:1787574461.202378:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 300 00000100:00100000:2.0:1787574461.202383:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323631360:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574461.202413:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323631360:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574461.202419:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 300 00000100:00080000:2.0:1787574461.202449:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574461.202453:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574461.202462:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323631104 00000100:00100000:2.0:1787574461.202466:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323631104 00000100:00080000:3.0:1787574461.202785:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574461.203115:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346800128:0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.204384:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574461.204443:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346800512:0@lo:400:kworker.0 00000100:00100000:1.0:1787574461.204481:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574461.204581:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346800000 00000100:00100000:3.0:1787574461.204589:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346800000 00000100:00100000:3.0:1787574461.204646:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346800512 00000100:00100000:3.0:1787574461.204650:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346800512 00000100:00100000:3.0:1787574461.204674:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787574461.204699:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346800000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574461.204752:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346800000:12345-0@lo:400:kworker.0 Request processed in 55us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574461.204759:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787574461.204776:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787574461.204782:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346800512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574461.204807:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346800512:12345-0@lo:400:kworker.0 Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574461.204813:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787574461.204943:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:2.0:1787574461.204953:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323631104:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574461.205007:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323631104:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 56us (3183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574461.205013:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00080000:1.0:1787574461.205280:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787574461.205311:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4b1c00 x1874407346800000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574461.205344:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346800000:0@lo:400:kworker.0 00010000:00080000:1.0:1787574461.205357:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4b2300 x1874407346800512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574461.205365:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346800512:0@lo:400:kworker.0 00000040:00080000:0.0:1787574461.554009:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787574461.554790:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787574462.132261:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574463.153980:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574464.178513:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574464.241657:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346800640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574464.241717:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346800768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574464.241739:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574464.241764:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574464.241846:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346800640 00000100:00100000:1.0:1787574464.241853:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346800640 00000100:00080000:0.0:1787574464.241893:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574464.241935:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346800768 00000100:00100000:0.0:1787574464.241939:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346800768 00000100:00100000:0.0:1787574464.241967:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787574464.241976:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346800640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574464.242014:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574464.242059:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346800640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574464.242066:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787574464.242085:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787574464.242091:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346800768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574464.242099:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574464.242120:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346800768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574464.242142:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1787574464.242155:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574464.242390:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346800640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574464.243058:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346800768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787574465.203277:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574465.779940:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574465.779966:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346800896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574465.780048:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574465.780307:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346800896 00000100:00100000:0.0:1787574465.780315:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346800896 00000100:00100000:0.0:1787574465.780378:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787574465.780391:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346800896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574465.780426:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574465.780487:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346800896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574465.780494:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787574465.780536:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346800896:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787574466.225424:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574466.292801:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574466.292825:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346801024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574466.292895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574466.293769:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346801024 00000100:00100000:1.0:1787574466.293777:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346801024 00000100:00100000:1.0:1787574466.293825:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787574466.293834:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346801024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574466.293867:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574466.293920:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346801024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574466.293927:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787574466.294016:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346801408:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294053:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.294085:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346801920:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294109:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.294137:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346802432:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294156:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.294179:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787574466.294184:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346801280:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294207:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.294222:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346801792:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294282:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.294297:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346802304:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294319:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.294344:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346801920 00000100:00100000:2.0:1787574466.294350:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346801920 00000100:00100000:2.0:1787574466.294395:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346802432 00000100:00100000:2.0:1787574466.294398:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346802432 00000100:00100000:2.0:1787574466.294417:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787574466.294423:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346801920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294459:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346801920:12345-0@lo:400:kworker.0 Request processed in 37us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574466.294480:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787574466.294493:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787574466.294499:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346802432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294543:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346802432:12345-0@lo:400:kworker.0 Request processed in 32us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574466.294549:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787574466.294587:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346801920:0@lo:400:kworker.0 00010000:00080000:2.0:1787574466.294599:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d52a00 x1874407346802432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574466.294610:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346802432:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294634:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346801536:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.294676:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346802048:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294696:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.294713:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346802048 00000100:00100000:2.0:1787574466.294716:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346802048 00000100:00100000:2.0:1787574466.294736:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787574466.294741:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346802048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294767:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346802048:12345-0@lo:400:kworker.0 Request processed in 26us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574466.294772:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787574466.294797:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346802048:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294802:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346802560:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294832:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.294849:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346802560 00000100:00100000:2.0:1787574466.294852:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346802560 00000100:00100000:2.0:1787574466.294875:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787574466.294881:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346802560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294909:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346802560:12345-0@lo:400:kworker.0 Request processed in 28us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574466.294915:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:2.0:1787574466.294939:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d50380 x1874407346802560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574466.294948:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346802560:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294959:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787574466.294965:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346801152:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.294994:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.295015:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346801664:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.295036:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.295050:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346802176:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.295067:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574466.295485:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346801280 00000100:00100000:0.0:1787574466.295491:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346801280 00000100:00100000:0.0:1787574466.295518:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346801792 00000100:00100000:0.0:1787574466.295521:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346801792 00000100:00100000:0.0:1787574466.295547:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346802304 00000100:00100000:0.0:1787574466.295550:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346802304 00000100:00100000:0.0:1787574466.295562:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346801536 00000100:00100000:0.0:1787574466.295564:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346801536 00000100:00100000:0.0:1787574466.295573:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346801664 00000100:00100000:0.0:1787574466.295575:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346801664 00000100:00100000:0.0:1787574466.295585:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346802176 00000100:00100000:0.0:1787574466.295587:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346802176 00000100:00100000:0.0:1787574466.295622:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787574466.295629:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346801280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574466.295684:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346801280:12345-0@lo:400:kworker.0 Request processed in 55us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.295691:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787574466.295704:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787574466.295711:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346801792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574466.295737:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346801792:12345-0@lo:400:kworker.0 Request processed in 28us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.295743:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787574466.295754:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787574466.295760:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346802304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574466.295787:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346802304:12345-0@lo:400:kworker.0 Request processed in 28us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.295792:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787574466.295802:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787574466.295808:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346801536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574466.295841:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346801536:12345-0@lo:400:kworker.0 Request processed in 33us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.295847:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787574466.295858:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787574466.295864:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346801664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574466.295889:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346801664:12345-0@lo:400:kworker.0 Request processed in 26us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.295895:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787574466.295918:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787574466.295924:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346802176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574466.295951:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346802176:12345-0@lo:400:kworker.0 Request processed in 28us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.295957:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:0.0:1787574466.295973:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574466.295976:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574466.295979:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574466.295981:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574466.295997:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346801408 00000100:00100000:0.0:1787574466.296001:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346801408 00000100:00100000:0.0:1787574466.296024:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787574466.296031:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346801408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574466.296061:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346801408:12345-0@lo:400:kworker.0 Request processed in 31us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.296068:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787574466.296098:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346801664:0@lo:400:kworker.0 00000100:00100000:0.0:1787574466.296108:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346802176:0@lo:400:kworker.0 00000100:00100000:0.0:1787574466.296118:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346801536:0@lo:400:kworker.0 00000100:00100000:0.0:1787574466.296156:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346801024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574466.296747:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346801152 00000100:00100000:3.0:1787574466.296753:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346801152 00000100:00100000:3.0:1787574466.296786:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1787574466.296793:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346801152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574466.296850:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346801152:12345-0@lo:400:kworker.0 Request processed in 57us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574466.296858:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1787574466.296895:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346802816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574466.296925:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574466.296960:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346802816 00000100:00100000:3.0:1787574466.296964:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346802816 00000100:00100000:3.0:1787574466.296989:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787574466.296995:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346802816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574466.297015:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574466.297046:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346802816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574466.297052:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:3.0:1787574466.297078:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5186d2300 x1874407346802816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574466.297092:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346802816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574466.297486:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346801152:0@lo:400:kworker.0 00000100:00100000:1.0:1787574466.297500:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574466.297506:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346802688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574466.297540:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574466.297769:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346801280:0@lo:400:kworker.0 00010000:00080000:2.0:1787574466.297782:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4be680 x1874407346801792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574466.297791:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346801792:0@lo:400:kworker.0 00010000:00080000:2.0:1787574466.297802:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403594e00 x1874407346802304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574466.297828:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346802304:0@lo:400:kworker.0 00000100:00100000:2.0:1787574466.297843:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346801408:0@lo:400:kworker.0 00000100:00100000:3.0:1787574466.297916:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346802688 00000100:00100000:3.0:1787574466.297921:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346802688 00000100:00100000:3.0:1787574466.297957:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787574466.297964:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53c0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346802688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574466.297977:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574466.298026:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53c0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346802688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574466.298032:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:1.0:1787574466.298303:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5186d0a80 x1874407346802688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574466.298331:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346802688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574466.313665:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574466.313707:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574466.313749:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574466.313835:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323631488 00000100:00100000:0.0:1787574466.313835:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323631744 00000100:00100000:1.0:1787574466.313845:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323631488 00000100:00100000:0.0:1787574466.313845:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323631744 00000100:00100000:1.0:1787574466.313893:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 386 00000100:00100000:0.0:1787574466.313897:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323631616 00000100:00100000:0.0:1787574466.313900:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323631616 00000100:00100000:1.0:1787574466.313903:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323631488:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574466.313919:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 309 00000100:00100000:0.0:1787574466.313925:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323631744:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574466.313974:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323631488:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 72us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574466.313981:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 386 00000100:00100000:3.0:1787574466.314064:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 310 00000100:00100000:3.0:1787574466.314080:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323631616:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:2.0:1787574466.315107:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574466.315114:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574466.318095:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323631744:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 4082us (4300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.318112:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 309 00000100:00100000:3.0:1787574466.329513:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323631616:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 15420us (15748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574466.329529:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 310 00000100:00100000:1.0:1787574466.330679:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574466.330868:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574466.330915:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574466.330943:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323632000 00000100:00100000:1.0:1787574466.330951:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323632000 00000100:00100000:1.0:1787574466.330999:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323632128 00000100:00100000:1.0:1787574466.331001:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323632128 00000100:00100000:1.0:1787574466.331346:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 311 00000100:00100000:1.0:1787574466.331371:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323632000:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574466.331443:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323632000:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 86us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.339170:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 312 00000100:00100000:0.0:1787574466.339198:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323632128:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574466.340079:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323631872 00000100:00100000:3.0:1787574466.340091:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323631872 00000100:00100000:3.0:1787574466.340163:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1787574466.340173:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2401:x1874407323631872:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:3.0:1787574466.340198:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb80da 00000100:00080000:3.0:1787574466.340207:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9ca402717800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574466.340267:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1787574466.340469:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323632128:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1284us (9551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574466.340479:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 312 00010000:00010000:0.0:1787574466.340606:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574466.340626:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574466.340630:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574466.340633:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574466.340829:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 311 00000100:00100000:3.0:1787574466.341797:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+2:2401:x1874407323631872:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 1613us (11113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574466.341813:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00010000:00010000:3.0:1787574467.250527:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574468.275693:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574469.297685:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574469.361639:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574469.361762:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574469.361781:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346803072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574469.361846:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574469.361915:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346803072 00000100:00100000:3.0:1787574469.361922:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346803072 00000100:00100000:3.0:1787574469.361970:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787574469.361979:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346803072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574469.362006:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574469.362055:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346803072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574469.362062:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787574469.362118:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346803072:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787574469.362144:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574469.369155:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346802944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574469.369231:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574469.369398:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346802944 00000100:00100000:2.0:1787574469.369407:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346802944 00000100:00100000:2.0:1787574469.369472:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787574469.369481:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346802944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574469.369503:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574469.369557:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346802944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574469.369564:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1787574469.369687:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574469.369757:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346802944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787574470.321460:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574470.899271:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346803200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574470.899381:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574470.899502:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346803200 00000100:00100000:2.0:1787574470.899513:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346803200 00000100:00100000:2.0:1787574470.899578:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787574470.899589:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346803200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574470.899630:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787574470.901648:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346803200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2046us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574470.901665:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787574470.904525:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346803200:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787574471.345520:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574471.409436:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346803328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574471.409523:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574471.409769:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346803712:0@lo:400:kworker.0 00000100:00100000:2.0:1787574471.409900:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574471.409989:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346803584:0@lo:400:kworker.0 00000100:00100000:2.0:1787574471.410067:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346804224:0@lo:400:kworker.0 00000100:00100000:2.0:1787574471.410096:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574471.410119:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346804736:0@lo:400:kworker.0 00000100:00100000:2.0:1787574471.410138:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574471.410201:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574471.410207:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346805120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574471.410231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574471.410300:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346803712 00000100:00100000:2.0:1787574471.410307:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346803712 00000100:00100000:2.0:1787574471.410374:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346804224 00000100:00100000:2.0:1787574471.410379:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346804224 00000100:00100000:2.0:1787574471.410406:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346804736 00000100:00100000:2.0:1787574471.410408:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346804736 00000100:00100000:3.0:1787574471.410424:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574471.410430:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787574471.410444:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346803712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574471.410480:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346804096:0@lo:400:kworker.0 00000100:00100000:2.0:1787574471.410517:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346803712:12345-0@lo:400:kworker.0 Request processed in 73us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574471.410535:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574471.410556:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346804608:0@lo:400:kworker.0 00000100:00100000:3.0:1787574471.410581:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574471.410619:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346805120 00000100:00100000:3.0:1787574471.411151:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346805120 00000100:00100000:3.0:1787574471.411211:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787574471.411221:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346805120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574471.411603:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574471.411953:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346805120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 732us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574471.411963:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1787574471.412001:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574471.412007:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574471.412026:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346803584 00000100:00100000:3.0:1787574471.412033:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346803584 00000100:00100000:3.0:1787574471.412074:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1787574471.412079:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787574471.412121:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346804096 00000100:00100000:2.0:1787574471.412127:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346804096 00000100:00100000:2.0:1787574471.412172:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346804608 00000100:00100000:2.0:1787574471.412175:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346804608 00000100:00100000:2.0:1787574471.412194:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787574471.412206:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346804224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574471.412304:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346804224:12345-0@lo:400:kworker.0 Request processed in 101us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574471.412324:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787574471.412346:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346803584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574471.412348:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787574471.412381:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346804736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574471.412409:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346803584:12345-0@lo:400:kworker.0 Request processed in 326us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574471.412427:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1787574471.412445:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346804736:12345-0@lo:400:kworker.0 Request processed in 69us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574471.412454:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787574471.412482:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00080000:3.0:1787574471.412483:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574471.412497:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346804096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574471.412524:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346803584:0@lo:400:kworker.0 00000100:00100000:0.0:1787574471.413118:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346803840:0@lo:400:kworker.0 00000100:00100000:3.0:1787574471.415696:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346804096:0@lo:400:kworker.0 00000100:00100000:3.0:1787574471.416751:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787574471.416780:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346804608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574471.417360:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346803328 00000100:00100000:1.0:1787574471.417372:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346803328 00000100:00100000:1.0:1787574471.417433:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787574471.417442:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346803328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574471.417478:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574471.417531:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346803328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (8008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574471.417539:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787574471.417579:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346803456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574471.417703:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346804608:12345-0@lo:400:kworker.0 Request processed in 478us (6658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574471.417712:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787574471.417788:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346804608:0@lo:400:kworker.0 00000100:00100000:0.0:1787574471.417872:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574471.417960:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346803840 00000100:00100000:3.0:1787574471.417966:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346803840 00000100:00100000:3.0:1787574471.417994:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787574471.418002:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346803840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574471.418038:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346804352:0@lo:400:kworker.0 00000100:00100000:3.0:1787574471.418040:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346803840:12345-0@lo:400:kworker.0 Request processed in 39us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574471.418055:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787574471.418098:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574471.418130:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346804864:0@lo:400:kworker.0 00000100:00100000:0.0:1787574471.418149:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574471.418154:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574471.418191:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346804352 00000100:00100000:0.0:1787574471.418200:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346804352 00000100:00100000:1.0:1787574471.418210:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346803968:0@lo:400:kworker.0 00000100:00100000:0.0:1787574471.418294:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346804864 00000100:00100000:0.0:1787574471.418325:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346804864 00000100:00100000:0.0:1787574471.418366:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787574471.418375:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346804352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574471.418394:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787574471.418408:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346804864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574471.419939:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574471.419994:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346804480:0@lo:400:kworker.0 00000100:00100000:1.0:1787574471.420035:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574471.420050:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346804992:0@lo:400:kworker.0 00000100:00100000:1.0:1787574471.420080:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574471.420142:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346803968 00000100:00100000:1.0:1787574471.420150:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346803968 00000100:00100000:1.0:1787574471.420195:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787574471.420204:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346803968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574471.420296:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346803968:12345-0@lo:400:kworker.0 Request processed in 93us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574471.420330:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787574471.420521:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346803968:0@lo:400:kworker.0 00000100:00100000:3.0:1787574471.423004:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346804864:12345-0@lo:400:kworker.0 Request processed in 4589us (4841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574471.423019:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787574471.423055:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346804480 00000100:00100000:3.0:1787574471.423064:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346804480 00000100:00100000:3.0:1787574471.423362:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346804992 00000100:00100000:3.0:1787574471.423367:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346804992 00000100:00100000:3.0:1787574471.423385:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787574471.423393:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346804480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574471.423480:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346804480:12345-0@lo:400:kworker.0 Request processed in 88us (3445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574471.423485:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787574471.423495:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787574471.423500:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346804992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574471.423521:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346804992:12345-0@lo:400:kworker.0 Request processed in 22us (3442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574471.423525:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787574471.423573:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346804480:0@lo:400:kworker.0 00010000:00080000:3.0:1787574471.423586:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf4b800 x1874407346804992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574471.423594:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346804992:0@lo:400:kworker.0 00010000:00080000:3.0:1787574471.424420:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366f480 x1874407346805120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574471.424445:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346805120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574471.424463:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346803712:0@lo:400:kworker.0 00010000:00080000:3.0:1787574471.424477:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4bf100 x1874407346804224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574471.424485:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346804224:0@lo:400:kworker.0 00010000:00080000:3.0:1787574471.424499:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4bc700 x1874407346804736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574471.424517:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346804736:0@lo:400:kworker.0 00000100:00100000:0.0:1787574471.425060:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346804352:12345-0@lo:400:kworker.0 Request processed in 1539us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574471.425078:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787574471.425150:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346803456 00000100:00100000:0.0:1787574471.425161:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346803456 00000100:00100000:0.0:1787574471.425232:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787574471.425262:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346803456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574471.425286:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574471.425397:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346803456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (7770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574471.425403:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1787574471.425425:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574471.425430:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574471.425471:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4bc380 x1874407346804864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574471.425487:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346804864:0@lo:400:kworker.0 00000100:00100000:0.0:1787574471.425507:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346803328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574471.425547:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346803840:0@lo:400:kworker.0 00000100:00100000:0.0:1787574471.425561:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346804352:0@lo:400:kworker.0 00010000:00080000:3.0:1787574471.432189:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4bea00 x1874407346803456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574471.432222:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346803456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574471.435013:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346804096:12345-0@lo:400:kworker.0 Request processed in 22515us (24479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574471.435031:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787574471.435335:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574471.435361:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574471.435385:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574471.435419:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574471.435558:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323632256 00000100:00100000:0.0:1787574471.435568:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323632256 00000100:00100000:0.0:1787574471.435609:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 388 00000100:00100000:0.0:1787574471.435618:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2402:x1874407323632256:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574471.435682:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2402:x1874407323632256:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 65us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574471.435688:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 388 00000100:00100000:0.0:1787574471.435716:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323632384 00000100:00100000:0.0:1787574471.435720:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323632384 00000100:00100000:0.0:1787574471.435751:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323632640 00000100:00100000:0.0:1787574471.435754:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323632640 00000100:00100000:0.0:1787574471.435769:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323632512 00000100:00100000:0.0:1787574471.435772:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323632512 00000100:00100000:0.0:1787574471.435789:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 319 00000100:00100000:0.0:1787574471.435795:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323632384:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574471.435827:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323632384:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 32us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574471.435833:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 319 00000100:00100000:0.0:1787574471.435844:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 320 00000100:00100000:0.0:1787574471.435851:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323632640:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574471.435875:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323632640:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574471.435881:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 320 00000100:00100000:0.0:1787574471.435893:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 321 00000100:00100000:0.0:1787574471.435899:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323632512:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574471.436531:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323632512:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 628us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574471.436539:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 321 00000100:00080000:0.0:1787574471.436666:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574471.436670:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574471.443503:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574471.443554:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323632768 00000100:00100000:3.0:1787574471.443564:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323632768 00000100:00100000:3.0:1787574471.443638:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 322 00000100:00100000:3.0:1787574471.443650:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323632768:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574471.443735:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323632768:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 88us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574471.443743:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 322 00000100:00080000:3.0:1787574471.443769:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1787574471.813456:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787574471.814720:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1787574471.931229:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000020:00000080:1.0:1787574471.931267:0:8419:0:(genops.c:885:class_export_put()) final put ffff9ca402710000/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000020:00000080:1.0:1787574471.931298:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca402710000/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 for lustre-OST0000 00000020:00000080:1.0:1787574471.931358:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca402717800 for lustre-OST0000 00010000:00010000:3.0:1787574472.372339:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574473.400930:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574474.419646:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574474.482558:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574474.482581:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346805248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574474.482645:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574474.482808:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346805376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574474.482835:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574474.482911:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346805248 00000100:00100000:0.0:1787574474.482920:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346805248 00000100:00100000:0.0:1787574474.482992:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346805376 00000100:00100000:0.0:1787574474.482995:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346805376 00000100:00100000:0.0:1787574474.483015:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787574474.483025:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346805248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574474.483052:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574474.483099:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346805248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574474.483106:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787574474.483136:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787574474.483143:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346805376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574474.483153:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574474.483182:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346805376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574474.483188:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787574474.483229:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346805376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574474.483297:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346805248:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787574474.483465:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787574475.442424:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574476.022103:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574476.022129:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346805504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574476.022208:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574476.022283:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346805504 00000100:00100000:2.0:1787574476.022292:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346805504 00000100:00100000:2.0:1787574476.022335:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787574476.022356:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346805504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574476.022394:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787574476.022453:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346805504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574476.022460:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787574476.022594:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346805504:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574476.465447:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574476.529423:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346805760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574476.529500:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574476.529549:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346805632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574476.529569:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574476.529581:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346806016:0@lo:400:kworker.0 00000100:00100000:3.0:1787574476.529597:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346806272:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.529612:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574476.529616:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574476.529630:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346806784:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.529630:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346806528:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.529649:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574476.529659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574476.529663:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346807040:0@lo:400:kworker.0 00000100:00100000:3.0:1787574476.529675:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787574476.529680:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346805888:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.529680:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574476.529696:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787574476.529701:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346806144:0@lo:400:kworker.0 00000100:00100000:3.0:1787574476.529702:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574476.529720:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346806400:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.529726:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574476.529738:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574476.529741:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346806656:0@lo:400:kworker.0 00000100:00100000:3.0:1787574476.529749:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346806912:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.529759:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574476.529765:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574476.529773:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346807168:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.529789:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574476.529790:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346805760 00000100:00100000:3.0:1787574476.529797:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346805760 00000100:00100000:2.0:1787574476.529811:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346806016 00000100:00100000:2.0:1787574476.529814:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346806016 00000100:00100000:2.0:1787574476.529840:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346806528 00000100:00100000:3.0:1787574476.529841:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346805632 00000100:00100000:3.0:1787574476.529842:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346805632 00000100:00100000:2.0:1787574476.529842:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346806528 00000100:00100000:2.0:1787574476.529853:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346807040 00000100:00100000:2.0:1787574476.529855:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346807040 00000100:00100000:3.0:1787574476.529857:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787574476.529864:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346805760:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574476.529864:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346806144 00000100:00100000:2.0:1787574476.529866:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346806144 00000100:00100000:2.0:1787574476.529874:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346806400 00000100:00100000:2.0:1787574476.529876:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346806400 00000100:00100000:2.0:1787574476.529885:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346806912 00000100:00100000:2.0:1787574476.529887:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346806912 00002000:00000024:3.0:1787574476.529893:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574476.529896:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787574476.529900:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346806016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.529934:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346806016:12345-0@lo:400:kworker.0 Request processed in 32us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574476.529939:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346805760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574476.529942:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787574476.529945:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787574476.529959:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787574476.529959:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787574476.529965:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346805632:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574476.529965:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346806528:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787574476.529973:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574476.529990:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346805632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 26us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574476.529990:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346806528:12345-0@lo:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574476.529996:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787574476.529996:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787574476.530007:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787574476.530019:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346807040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574476.530020:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346806272 00000100:00100000:3.0:1787574476.530023:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346806272 00000100:00100000:2.0:1787574476.530044:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346807040:12345-0@lo:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574476.530049:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787574476.530051:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787574476.530056:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346806272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.530059:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787574476.530063:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346806144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574476.530083:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346806272:12345-0@lo:400:kworker.0 Request processed in 27us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574476.530083:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346806144:12345-0@lo:400:kworker.0 Request processed in 19us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574476.530089:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787574476.530089:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787574476.530099:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787574476.530104:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346806400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574476.530105:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346806784 00000100:00100000:3.0:1787574476.530108:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346806784 00000100:00100000:2.0:1787574476.530127:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346806400:12345-0@lo:400:kworker.0 Request processed in 23us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574476.530129:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346806656 00000100:00100000:3.0:1787574476.530131:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346806656 00000100:00100000:2.0:1787574476.530133:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787574476.530143:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346807168 00000100:00100000:2.0:1787574476.530143:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787574476.530145:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346807168 00000100:00100000:2.0:1787574476.530148:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346806912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574476.530153:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787574476.530158:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346806784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574476.530183:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346806784:12345-0@lo:400:kworker.0 Request processed in 25us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574476.530184:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346806912:12345-0@lo:400:kworker.0 Request processed in 35us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574476.530189:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787574476.530201:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787574476.530211:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787574476.530215:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787574476.530217:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346806656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.530221:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346807168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574476.530276:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346806656:12345-0@lo:400:kworker.0 Request processed in 47us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574476.530276:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346807168:12345-0@lo:400:kworker.0 Request processed in 43us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574476.530282:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787574476.530336:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346806144:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.530355:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346806656:0@lo:400:kworker.0 00010000:00080000:2.0:1787574476.530367:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca402506300 x1874407346807168/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574476.530375:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346807168:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.530384:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346806016:0@lo:400:kworker.0 00010000:00080000:2.0:1787574476.530393:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca504593b80 x1874407346806528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574476.530400:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346806528:0@lo:400:kworker.0 00010000:00080000:2.0:1787574476.530408:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034ddc00 x1874407346807040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574476.530416:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346807040:0@lo:400:kworker.0 00000100:00080000:2.0:1787574476.530462:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574476.530467:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574476.530469:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574476.530471:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574476.530487:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346805888 00000100:00100000:2.0:1787574476.530491:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346805888 00000100:00100000:2.0:1787574476.530517:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1787574476.530523:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346805888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.530554:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3636:x1874407346805888:12345-0@lo:400:kworker.0 Request processed in 31us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574476.530559:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1787574476.530604:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346805888:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.530626:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346806400:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.530634:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346806912:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.530642:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346806272:0@lo:400:kworker.0 00000100:00100000:2.0:1787574476.530650:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346806784:0@lo:400:kworker.0 00010000:00080000:2.0:1787574476.530660:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5186d0380 x1874407346805760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574476.530673:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346805760:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787574476.530682:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40366ed80 x1874407346805632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574476.530691:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346805632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574476.530748:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787574476.535197:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346807296:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574476.535300:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574476.535399:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346807296 00000100:00100000:1.0:1787574476.535409:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346807296 00000100:00100000:1.0:1787574476.535459:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787574476.535469:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346807296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574476.535503:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574476.535559:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346807296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574476.535574:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787574476.535657:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346807296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574476.555010:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574476.555053:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574476.555082:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323632896 00000100:00100000:3.0:1787574476.555092:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323632896 00000100:00100000:3.0:1787574476.555140:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 390 00000100:00100000:3.0:1787574476.555151:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2402:x1874407323632896:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574476.555257:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2402:x1874407323632896:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574476.555284:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 390 00000100:00100000:0.0:1787574476.556971:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574476.559258:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574476.562985:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323633152 00000100:00100000:2.0:1787574476.563001:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323633152 00000100:00100000:2.0:1787574476.563099:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323633408 00000100:00100000:2.0:1787574476.563103:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323633408 00000100:00100000:2.0:1787574476.563129:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 329 00000100:00100000:3.0:1787574476.563138:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 330 00000100:00100000:2.0:1787574476.563139:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323633152:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574476.563147:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323633408:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574476.563217:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323633152:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 79us (8162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574476.563225:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 329 00000100:00100000:3.0:1787574476.563261:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323633408:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 116us (6297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574476.563278:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 330 00000100:00080000:1.0:1787574476.563907:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574476.565351:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574476.565379:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323633024 00000100:00100000:0.0:1787574476.565387:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323633024 00000100:00100000:0.0:1787574476.565434:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323633280 00000100:00100000:0.0:1787574476.565437:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323633280 00000100:00100000:0.0:1787574476.565459:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 331 00000100:00100000:0.0:1787574476.565467:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323633024:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574476.565523:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323633024:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 56us (6294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574476.565530:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 331 00000100:00100000:0.0:1787574476.565546:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 332 00000100:00100000:0.0:1787574476.565552:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323633280:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574476.565576:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323633280:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574476.565581:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 332 00000100:00080000:1.0:1787574476.565658:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787574477.172716:0:14060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:27:54 (1787574474) 00010000:00010000:2.0:1787574477.491023:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574478.513943:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574479.482438:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574479.483321:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323633536 00000100:00100000:0.0:1787574479.483333:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323633536 00000100:00100000:0.0:1787574479.483418:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:0.0:1787574479.483431:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:11108:x1874407323633536:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574479.483455:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574479.483481:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb81ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b651 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.483546:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb81c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.483575:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb81c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.483590:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb81c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574479.483632:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574479.483636:0:8610:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574479.483674:0:8610:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb81c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.483697:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb81ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b651 expref: 7 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.483717:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb81c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b651 expref: 6 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.483725:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4c000) 00010000:00010000:0.0:1787574479.483728:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574479.483731:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11a00, rc 0) 00000100:00100000:0.0:1787574479.483803:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:11108:x1874407323633536:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 375us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574479.483810:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00080000:1.0:1787574479.486095:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574479.501868:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574479.501967:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323633664 00000100:00100000:0.0:1787574479.501977:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323633664 00000100:00100000:0.0:1787574479.502036:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:0.0:1787574479.502046:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:11109:x1874407323633664:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574479.502065:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574479.502095:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb81c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b658 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502172:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb81cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502185:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb81cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502196:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb81cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502209:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb81d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502216:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb81d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502222:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb81d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502333:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb81dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502341:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb81dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502347:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb81dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574479.502390:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574479.502395:0:11515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574479.502418:0:11515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb81dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502434:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb81cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502440:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb81cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502446:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb81cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502451:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574479.502456:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb81cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502462:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb81cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502475:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4c000) 00010000:00010000:0.0:1787574479.502478:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574479.502482:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb81cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502488:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb81cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502502:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb81d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502508:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb81d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502513:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb81d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502525:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574479.502528:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb81d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502533:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb81d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502542:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ca534a4cf00) 00010000:00010000:0.0:1787574479.502544:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574479.502547:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb81d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502552:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb81d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502581:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb81c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b658 expref: 8 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502593:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb81dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b658 expref: 7 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574479.502600:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ca534a4c700) 00010000:00010000:0.0:1787574479.502602:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574479.502604:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10600, rc 0) 00000100:00100000:0.0:1787574479.502675:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:11109:x1874407323633664:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 629us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574479.502682:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:3.0:1787574479.507091:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574479.507342:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323633792 00000100:00100000:0.0:1787574479.507366:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323633792 00000100:00100000:0.0:1787574479.507429:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1787574479.507440:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:11109:x1874407323633792:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787574479.507515:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:11109:x1874407323633792:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 Request processed in 76us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574479.507523:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1787574479.529547:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574479.529822:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323634048 00000100:00100000:2.0:1787574479.529833:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323634048 00000100:00100000:2.0:1787574479.529956:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:2.0:1787574479.529968:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:11109:x1874407323634048:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574479.529990:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574479.530011:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb81e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b65f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530131:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb81eb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530148:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb81eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530158:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb81eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530205:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb81f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530213:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb81f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530220:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb81f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530415:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83400/0xd18a1efeeddb81f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530424:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83400/0xd18a1efeeddb81f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530445:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83400/0xd18a1efeeddb81f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574479.530455:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787574479.530538:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb81eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530545:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb81eb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530552:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb81eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530558:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574479.530563:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb81eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530569:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb81eb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530580:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ca534a4c700) 00010000:00010000:2.0:1787574479.530583:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574479.530587:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb81eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530593:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb81eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530605:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb81f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530611:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb81f2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530622:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb81f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530627:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574479.530630:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb81f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530636:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb81f2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530642:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ca52057f900) 00010000:00010000:2.0:1787574479.530644:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574479.530646:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb81f2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530651:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb81f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530913:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb81e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b65f expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530926:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83400/0xd18a1efeeddb81f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b65f expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574479.530933:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:2.0:1787574479.530935:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574479.530937:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83400, rc 0) 00000100:00100000:2.0:1787574479.530995:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:11109:x1874407323634048:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1030us (1457us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787574479.531012:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00010000:00010000:3.0:1787574479.542104:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574479.543130:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574479.544207:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323634176 00000100:00100000:0.0:1787574479.544221:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323634176 00000100:00100000:0.0:1787574479.544323:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:0.0:1787574479.544333:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:11109:x1874407323634176:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787574479.544464:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:11109:x1874407323634176:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 132us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574479.544472:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:0.0:1787574479.561573:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574479.561650:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323634304 00000100:00100000:2.0:1787574479.561662:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323634304 00000100:00100000:2.0:1787574479.561729:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:2.0:1787574479.561739:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:11109:x1874407323634304:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1787574479.563405:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787574479.571691:0:6511:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9629us 00000100:00100000:1.0:1787574479.602984:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574479.603005:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5350e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346807424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574479.603083:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574479.603161:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346807424 00000100:00100000:1.0:1787574479.603168:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346807424 00000100:00100000:1.0:1787574479.603219:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787574479.603229:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346807424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574479.603298:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574479.603354:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346807424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574479.603361:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1787574479.603400:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574479.603436:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5350e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346807424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574479.611772:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:11109:x1874407323634304:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 50026us (50200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574479.611786:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:0.0:1787574479.626936:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574479.632300:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346807552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574479.632374:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574479.632504:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346807552 00000100:00100000:0.0:1787574479.632511:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346807552 00000100:00100000:0.0:1787574479.632574:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787574479.632583:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346807552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574479.632608:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574479.632671:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346807552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574479.632678:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787574479.632726:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346807552:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787574479.639107:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787574479.988856:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787574479.993764:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787574480.564051:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574481.011361:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787574481.014307:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787574481.140149:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574481.140173:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346807680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574481.140275:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574481.140378:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346807680 00000100:00100000:0.0:1787574481.140386:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346807680 00000100:00100000:0.0:1787574481.140439:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787574481.140449:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346807680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574481.140495:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787574481.140541:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346807680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574481.140548:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787574481.140621:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346807680:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574481.587511:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574481.649460:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346807808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574481.649548:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.649604:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574481.649612:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346807936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574481.649635:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.649668:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346807808 00000100:00100000:3.0:1787574481.649676:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346807808 00000100:00100000:3.0:1787574481.649723:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346807936 00000100:00100000:3.0:1787574481.649726:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346807936 00000100:00100000:3.0:1787574481.649744:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787574481.649753:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346807808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574481.649792:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574481.649835:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346807808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.649842:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787574481.649859:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787574481.649866:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346807936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574481.649876:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574481.649899:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346807936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.649904:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1787574481.649923:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787574481.649951:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5186d1500 x1874407346807936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574481.649969:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346807936:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787574481.649980:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5186d0e00 x1874407346807808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574481.649990:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346807808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574481.650108:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346808064:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650137:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.650159:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346808576:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650183:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.650199:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346809088:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650217:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.650282:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787574481.650288:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346808192:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650310:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.650328:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346808704:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650349:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.650368:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346809216:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650386:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.650412:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346808448:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650436:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.650456:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346808960:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650478:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.650496:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787574481.650501:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346808320:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650525:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.650535:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346808832:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650553:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.650578:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346808064 00000100:00100000:3.0:1787574481.650583:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346808064 00000100:00100000:3.0:1787574481.650610:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1787574481.650617:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346808064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650650:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346808064:12345-0@lo:400:kworker.0 Request processed in 34us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.650655:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1787574481.650682:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346808576 00000100:00100000:3.0:1787574481.650686:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346808576 00000100:00100000:3.0:1787574481.650709:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346809088 00000100:00100000:3.0:1787574481.650717:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346809088 00000100:00100000:3.0:1787574481.650732:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346808192 00000100:00100000:3.0:1787574481.650734:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346808192 00000100:00100000:3.0:1787574481.650744:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346808704 00000100:00100000:3.0:1787574481.650746:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346808704 00000100:00100000:3.0:1787574481.650758:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346809216 00000100:00100000:3.0:1787574481.650761:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346809216 00000100:00100000:3.0:1787574481.650770:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346808320 00000100:00100000:3.0:1787574481.650772:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346808320 00000100:00100000:3.0:1787574481.650786:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787574481.650791:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346808576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650821:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346808576:12345-0@lo:400:kworker.0 Request processed in 30us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.650827:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787574481.650840:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787574481.650846:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346809088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650871:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346809088:12345-0@lo:400:kworker.0 Request processed in 26us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.650877:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787574481.650888:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787574481.650894:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346808192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650919:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346808192:12345-0@lo:400:kworker.0 Request processed in 26us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.650925:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787574481.650936:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787574481.650942:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346808704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.650967:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346808704:12345-0@lo:400:kworker.0 Request processed in 26us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.650981:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787574481.650994:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787574481.650999:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346809216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651024:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346809216:12345-0@lo:400:kworker.0 Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.651029:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787574481.651038:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787574481.651044:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346808320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651075:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346808320:12345-0@lo:400:kworker.0 Request processed in 31us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.651081:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787574481.651108:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346808448 00000100:00100000:3.0:1787574481.651111:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346808448 00000100:00100000:3.0:1787574481.651137:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787574481.651144:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346808448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651173:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346808448:12345-0@lo:400:kworker.0 Request processed in 30us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.651179:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787574481.651197:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346808960 00000100:00100000:3.0:1787574481.651200:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346808960 00000100:00100000:3.0:1787574481.651237:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346808832 00000100:00100000:3.0:1787574481.651258:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346808832 00000100:00100000:3.0:1787574481.651280:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787574481.651285:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346808960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651313:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346808960:12345-0@lo:400:kworker.0 Request processed in 27us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.651327:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787574481.651338:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787574481.651343:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346808832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651366:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346808832:12345-0@lo:400:kworker.0 Request processed in 24us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.651370:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787574481.651395:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574481.651399:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574481.651401:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574481.651426:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346808320:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651437:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346808832:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651445:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346808448:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651454:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346808960:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651484:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346808192:0@lo:400:kworker.0 00010000:00080000:3.0:1787574481.651495:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4be680 x1874407346808704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574481.651503:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346808704:0@lo:400:kworker.0 00010000:00080000:3.0:1787574481.651513:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4be300 x1874407346809216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574481.651520:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346809216:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651528:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346808064:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651536:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346808576:0@lo:400:kworker.0 00000100:00100000:3.0:1787574481.651554:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346809088:0@lo:400:kworker.0 00000100:00100000:1.0:1787574481.651837:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574481.651853:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5030bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346809344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574481.651887:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574481.652617:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346809344 00000100:00100000:3.0:1787574481.652625:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346809344 00000100:00100000:3.0:1787574481.652672:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787574481.652681:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346809344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574481.652712:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574481.652764:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346809344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.652771:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787574481.652938:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5030bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346809344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574481.675553:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574481.675599:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574481.675624:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574481.675646:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574481.675685:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574481.675719:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323634688 00000100:00100000:1.0:1787574481.675731:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323634688 00000100:00100000:1.0:1787574481.675789:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323634944 00000100:00100000:1.0:1787574481.675793:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323634944 00000100:00100000:1.0:1787574481.675807:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323634560 00000100:00100000:1.0:1787574481.675809:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323634560 00000100:00100000:1.0:1787574481.675824:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323634816 00000100:00100000:1.0:1787574481.675826:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323634816 00000100:00100000:1.0:1787574481.675841:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 339 00000100:00100000:1.0:1787574481.675850:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323634688:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574481.675931:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323634688:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 81us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574481.675939:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 339 00000100:00100000:1.0:1787574481.675960:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 340 00000100:00100000:1.0:1787574481.675966:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323634944:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574481.675988:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323634944:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574481.675994:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 340 00000100:00100000:1.0:1787574481.676004:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 341 00000100:00100000:1.0:1787574481.676017:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2403:x1874407323634560:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574481.676038:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2403:x1874407323634560:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574481.676044:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 341 00000100:00100000:1.0:1787574481.676057:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 342 00000100:00100000:1.0:1787574481.676062:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323634816:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574481.676081:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323634816:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 19us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574481.676087:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 342 00000100:00080000:1.0:1787574481.676185:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574481.676189:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787574481.676363:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323634432 00000100:00100000:2.0:1787574481.676368:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323634432 00000100:00100000:2.0:1787574481.676398:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 392 00000100:00100000:2.0:1787574481.676405:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2403:x1874407323634432:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574481.676435:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2403:x1874407323634432:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 30us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574481.676440:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 392 00000100:00100000:3.0:1787574481.812986:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574481.813064:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323635072 00000100:00100000:0.0:1787574481.813073:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323635072 00000100:00100000:0.0:1787574481.813138:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:0.0:1787574481.813148:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:11151:x1874407323635072:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574481.813167:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574481.813186:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb8207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b666 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813284:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb820e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813298:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb820e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813308:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb820e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813320:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8215 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813326:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813344:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813380:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb820e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813386:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb820e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813392:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb820e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813398:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574481.813402:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb820e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813409:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb820e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813420:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4c000) 00010000:00010000:0.0:1787574481.813423:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574481.813426:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb820e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813433:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb820e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813444:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813449:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8215 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813460:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8215 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813465:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574481.813467:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8215 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813473:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8215 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813480:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ca534a4cf00) 00010000:00010000:0.0:1787574481.813482:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574481.813485:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8215 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813489:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8215 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813518:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb8207 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b666 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813528:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4c000) 00010000:00010000:0.0:1787574481.813530:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574481.813533:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb8207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b666 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574481.813542:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10000, rc 0) 00000100:00100000:0.0:1787574481.813598:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:11151:x1874407323635072:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 451us (620us total) trans 0 rc 301/301 00000100:00100000:0.0:1787574481.813612:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:1.0:1787574481.826550:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574481.826591:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323635328 00000100:00100000:3.0:1787574481.826602:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323635328 00000100:00100000:2.0:1787574481.826870:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:2.0:1787574481.826882:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:11151:x1874407323635328:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:2.0:1787574481.826944:0:11515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574481.826973:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb81c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b651 expref: 9 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827005:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4c000) 00010000:00010000:2.0:1787574481.827015:0:11515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574481.827079:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb821c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827093:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb821c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827103:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb821c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827117:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827123:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827128:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827608:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827615:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827620:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787574481.827630:0:11515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084614379 reply state 000000002dafca9e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827646:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827650:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:2.0:1787574481.827652:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787574481.827654:0:11515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787574481.827658:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787574481.827664:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb821c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827668:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb821c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827672:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb821c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827676:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574481.827679:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb821c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827683:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb821c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827688:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca52057f000) 00010000:00010000:2.0:1787574481.827690:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574481.827692:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb821c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827696:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb821c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787574481.827711:0:11515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084614379 reply state 000000002dafca9e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827716:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574481.827720:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ca52057f100) 00010000:00010000:2.0:1787574481.827721:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787574481.827722:0:11515:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787574481.827801:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:11151:x1874407323635328:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 922us (1258us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787574481.827809:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:0.0:1787574481.955355:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574481.955594:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323635456 00000100:00100000:3.0:1787574481.955606:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323635456 00000100:00100000:3.0:1787574481.955677:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:3.0:1787574481.955689:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:11159:x1874407323635456:12345-192.168.202.40@tcp:101:lctl.0 00010000:00010000:3.0:1787574481.955716:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574481.955741:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b66d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574481.955814:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8238 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574481.955839:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574481.955850:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574481.955923:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787574481.955928:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574481.955967:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574481.955994:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b66d expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574481.956011:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b66d expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574481.956020:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:3.0:1787574481.956023:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574481.956026:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be98800, rc 0) 00000100:00100000:3.0:1787574481.956089:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:11159:x1874407323635456:12345-192.168.202.40@tcp:101:lctl.0 Request processed in 402us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574481.956098:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:3.0:1787574482.012519:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574482.012651:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323635584 00000100:00100000:1.0:1787574482.012662:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323635584 00000100:00100000:1.0:1787574482.012727:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:1.0:1787574482.012738:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:11165:x1874407323635584:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574482.012758:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574482.012778:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb823f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b674 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.012845:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8246 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.012860:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.012872:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.012899:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb824d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.012907:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb824d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.012914:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb824d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013000:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb8254 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013009:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb8254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013016:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb8254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574482.013051:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787574482.013055:0:8610:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574482.013094:0:8610:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb8254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013106:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8246 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013112:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8246 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013119:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8246 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013149:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574482.013154:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8246 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013162:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8246 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013175:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:1.0:1787574482.013178:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574482.013182:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8246 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013189:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8246 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013203:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb824d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013208:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb824d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013223:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb824d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013229:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574482.013232:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb824d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013297:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb824d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013317:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ca52057f100) 00010000:00010000:1.0:1787574482.013320:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574482.013323:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb824d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013329:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb824d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013354:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb823f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b674 expref: 13 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013367:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb8254 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b674 expref: 12 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.013373:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:1.0:1787574482.013375:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787574482.013378:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74a00, rc 0) 00000100:00100000:1.0:1787574482.013432:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:11165:x1874407323635584:12345-192.168.202.40@tcp:101:bash.0 Request processed in 696us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574482.013439:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:1.0:1787574482.018642:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574482.018740:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323635840 00000100:00100000:2.0:1787574482.018750:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323635840 00000100:00100000:2.0:1787574482.018814:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:2.0:1787574482.018825:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:11165:x1874407323635840:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574482.018847:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574482.018869:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb825b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b67b expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.018972:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb8262 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.018984:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb8262 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.018995:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb8262 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.019075:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.019083:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.019091:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787574482.019770:0:11515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787574482.019908:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8270 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.019919:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.019926:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.019958:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb8262 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.019965:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb8262 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.019972:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb8262 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.019978:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574482.019982:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb8262 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.019999:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb8262 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.020011:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:2.0:1787574482.020014:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574482.020018:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb8262 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.020024:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb8262 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787574482.020202:0:11515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d0bf729 reply state 0000000039c31cae transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.020214:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.020228:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca52057f000) 00010000:00010000:2.0:1787574482.020230:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787574482.020233:0:11515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787574482.020335:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb825b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b67b expref: 15 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.020349:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8270 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b67b expref: 14 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.020356:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca52057fb00) 00010000:00010000:2.0:1787574482.020358:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574482.020360:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83200, rc 0) 00000100:00100000:2.0:1787574482.020433:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:11165:x1874407323635840:12345-192.168.202.40@tcp:101:bash.0 Request processed in 1609us (1801us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787574482.020440:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:0.0:1787574482.025675:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.025761:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323635968 00000100:00100000:3.0:1787574482.025772:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323635968 00000100:00100000:3.0:1787574482.025820:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:3.0:1787574482.025829:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874407323635968:12345-192.168.202.40@tcp:8:bash.0 00010000:00080000:3.0:1787574482.025878:0:8619:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:3.0:1787574482.025910:0:8619:0:(genops.c:1385:class_connect()) connect: client 1aeb3668-c6f6-4338-ab9b-0a7c9161b421, cookie 0xd18a1efeeddb827e 00002000:00100000:3.0:1787574482.025923:0:8619:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1aeb3668-c6f6-4338-ab9b-0a7c9161b421/ffff9ca53f4a2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787574482.025933:0:8619:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787574482.026017:0:8619:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787574482.026048:0:8619:0:(import.c:65:import_set_state_nolock()) ffff9ca53f4a1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574482.026122:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2401:x1874407323635968:12345-192.168.202.40@tcp:8:bash.0 Request processed in 293us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574482.026136:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:3.0:1787574482.028965:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574482.029126:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323636096 00000100:00100000:0.0:1787574482.029145:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323636096 00000100:00100000:0.0:1787574482.029228:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1787574482.029283:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:0:x1874407323636096:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1787574482.029308:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574482.029333:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb8285 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b682 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574482.029359:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574482.029378:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1787574482.029382:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574482.029392:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb8285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b682 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.029411:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb8285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b682 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.029426:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10200, rc 0) 00000100:00100000:0.0:1787574482.029478:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:0:x1874407323636096:12345-192.168.202.40@tcp:101:bash.0 Request processed in 240us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574482.029484:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00080000:1.0:1787574482.030097:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574482.035092:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.035283:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323636224 00000100:00100000:3.0:1787574482.035293:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323636224 00000100:00100000:3.0:1787574482.035348:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:3.0:1787574482.035358:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:11165:x1874407323636224:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1787574482.035377:0:8619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574482.035398:0:8619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b689 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.035429:0:8619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb8285 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b682 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.035438:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574482.035443:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574482.035448:0:8619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 8 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.035484:0:8619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb8285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b682 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.035499:0:8619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb8285 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b682 expref: 8 pid: 8426 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574482.035534:0:8619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8619:1874407346809472:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574482.035632:0:8619:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574482.038582:0:8619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8619:1874407346809472:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574482.038618:0:8619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 8 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.038638:0:8619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99a00, rc 0) 00000100:00100000:3.0:1787574482.038694:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:11165:x1874407323636224:12345-192.168.202.40@tcp:101:bash.0 Request processed in 3335us (3612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574482.038701:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:1.0:1787574482.041368:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.041454:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323636352 00000100:00100000:3.0:1787574482.041464:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323636352 00010000:00010000:3.0:1787574482.041505:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb8285 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b682 expref: 8 pid: 8426 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574482.041546:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:3.0:1787574482.041557:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b688c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323636352:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574482.041570:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574482.041590:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb8285 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b682 expref: 8 pid: 8426 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.041604:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb8285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b682 expref: 8 pid: 8426 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.041649:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb8285 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b682 expref: 8 pid: 8426 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.041665:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574482.041670:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574482.041678:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 7 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.041687:0:7451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 7 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.041723:0:7451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 7 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574482.041738:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7451:1874407346809600:192.168.202.40@tcp:105: 00000100:00100000:3.0:1787574482.041817:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574482.046510:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.046646:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7451:1874407346809600:192.168.202.40@tcp:105: 00010000:00010000:3.0:1787574482.046671:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574482.046726:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b688c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323636352:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 5171us (5368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574482.046736:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:2.0:1787574482.047104:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323636608 00000100:00100000:2.0:1787574482.047112:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323636608 00000100:00100000:2.0:1787574482.047165:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:2.0:1787574482.047173:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:11165:x1874407323636608:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:2.0:1787574482.047463:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:11165:x1874407323636608:12345-192.168.202.40@tcp:35:bash.0 Request processed in 289us (962us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787574482.047469:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1787574482.112987:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574482.113108:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323636864 00000100:00100000:0.0:1787574482.113131:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323636864 00000100:00100000:0.0:1787574482.113203:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1787574482.113268:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:11175:x1874407323636864:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574482.113296:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574482.113319:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b690 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574482.113426:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787574482.113536:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8293 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b690 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.113551:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:0.0:1787574482.113554:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574482.113561:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b690 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.113583:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11600, rc 0) 00000100:00100000:0.0:1787574482.113698:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:11175:x1874407323636864:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 483us (721us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1787574482.113705:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:3.0:1787574482.122347:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574482.124577:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323637120 00000100:00100000:2.0:1787574482.124594:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323637120 00000100:00100000:2.0:1787574482.124714:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1787574482.124725:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:11175:x1874407323637120:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1787574482.125322:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:11175:x1874407323637120:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 597us (2983us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787574482.125330:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1787574482.247361:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574482.248345:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323637248 00000100:00100000:1.0:1787574482.248373:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323637248 00000100:00100000:1.0:1787574482.248442:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1787574482.248452:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:11181:x1874407323637248:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1787574482.248479:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574482.248500:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb82a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b697 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.248570:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb82a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.248584:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb82a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.248595:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb82a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574482.248639:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787574482.248643:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574482.248677:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb82a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.248705:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb82a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b697 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.248724:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb82a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b697 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.248733:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:1.0:1787574482.248735:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787574482.248738:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75000, rc 0) 00000100:00100000:1.0:1787574482.248815:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:11181:x1874407323637248:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 364us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574482.248822:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1787574482.265327:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574482.265476:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323637504 00000100:00100000:2.0:1787574482.265487:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323637504 00000100:00100000:2.0:1787574482.265551:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:2.0:1787574482.265564:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:11181:x1874407323637504:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574482.265589:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574482.265615:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb82af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b69e expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.265737:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb82b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.265763:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb82b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.265775:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb82b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574482.265787:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787574482.265913:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb82af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b69e expref: 22 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.265932:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb82b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b69e expref: 21 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.265941:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca52057fb00) 00010000:00010000:2.0:1787574482.265944:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574482.265948:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83c00, rc 0) 00000100:00100000:2.0:1787574482.266012:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:11181:x1874407323637504:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 450us (695us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787574482.266019:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:2.0:1787574482.272313:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574482.272349:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574482.272456:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323637760 00000100:00100000:0.0:1787574482.272467:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323637760 00000100:00100000:0.0:1787574482.272538:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:0.0:1787574482.272548:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:11181:x1874407323637760:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574482.272573:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574482.272595:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb82c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.272717:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb82cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.272732:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb82cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.272744:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb82cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574482.272756:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787574482.272877:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb82c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6a5 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.272897:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb82cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6a5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.272905:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca52057fb00) 00010000:00010000:0.0:1787574482.272908:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787574482.272912:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10200, rc 0) 00000100:00100000:0.0:1787574482.272977:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:11181:x1874407323637760:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 430us (673us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787574482.272984:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:3.0:1787574482.274147:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323637888 00000100:00100000:3.0:1787574482.274173:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323637888 00000100:00100000:3.0:1787574482.274270:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1787574482.274281:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:2404:x1874407323637888:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574482.274294:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574482.274314:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb82b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b69e expref: 23 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.274329:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca52057fb00) 00010000:00010000:3.0:1787574482.274333:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574482.274380:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:2404:x1874407323637888:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 101us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574482.274388:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:2.0:1787574482.291914:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574482.292496:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323638016 00000100:00100000:0.0:1787574482.292507:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323638016 00000100:00100000:0.0:1787574482.292571:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:0.0:1787574482.292583:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323638016:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:0.0:1787574482.292633:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.292675:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 7 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.292683:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574482.292688:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787574482.292692:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.292741:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 7 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.292756:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 7 pid: 8619 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574482.292770:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874407346809728:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574482.295329:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4033ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574482.302979:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574482.303501:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323638144 00000100:00100000:2.0:1787574482.303511:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323638144 00002000:00100000:2.0:1787574482.303561:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9ca53f4f4e00 x1874407323638144/t0(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:253/0 lens 504/0 e 0 to 0 dl 1787574493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574482.303572:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca53f4f4e00 with x1874407323638144 ext(0->12) 00010000:00010000:2.0:1787574482.303594:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 8 pid: 8619 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.303612:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 8 pid: 8619 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574482.303620:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ca53f4f4e00 00000100:00100000:2.0:1787574482.303659:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1787574482.303670:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323638144:12345-192.168.202.40@tcp:4:lfs.0 00000100:00100000:3.0:1787574482.308647:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874407346809728:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574482.308677:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1787574482.309730:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000100:00100000:2.0:1787574482.310929:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2405:x1874407323638144:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 7248us (7948us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787574482.310943:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00002000:00100000:2.0:1787574482.310957:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9ca53f4f4e00 x1874407323638144/t4294967300(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:253/0 lens 504/448 e 0 to 0 dl 1787574493 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574482.310968:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca53f4f4e00 with x1874407323638144 ext(0->12) 00010000:00010000:2.0:1787574482.310978:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 9 pid: 8619 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.310997:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 9 pid: 8619 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574482.311005:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ca53f4f4e00 00000100:00100000:2.0:1787574482.318427:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574482.318531:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323638272 00000100:00100000:1.0:1787574482.318542:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323638272 00010000:00010000:1.0:1787574482.318587:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 9 pid: 8619 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574482.318629:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:1.0:1787574482.318640:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2402:x1874407323638272:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574482.318655:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787574482.318675:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787574482.318678:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787574481 00002000:00010000:1.0:1787574482.318680:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787574481 00002000:00010000:1.0:1787574482.318682:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787574481 00002000:00010000:1.0:1787574482.318684:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787574482.318691:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 9 pid: 8619 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.318705:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 9 pid: 8619 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.318728:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003116985d/0xd18a1efeeddb828c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b689 expref: 9 pid: 8619 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.318745:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574482.318763:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574482.318769:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.318779:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.318818:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574482.319115:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.319136:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.319158:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.319174:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.319183:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.319195:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574482.319200:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.319208:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574482.319621:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2402:x1874407323638272:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 980us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574482.319630:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00010000:00010000:0.0:1787574482.321056:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.321068:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb82d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574482.321694:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323638016:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 29106us (29783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574482.321706:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:2.0:1787574482.333484:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574482.333604:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323638528 00000100:00100000:0.0:1787574482.333615:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323638528 00000100:00100000:0.0:1787574482.333676:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1787574482.333688:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:11181:x1874407323638528:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:0.0:1787574482.333755:0:6512:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb82cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6a5 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574482.333998:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1787574482.334045:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787574482.337511:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1787574482.337586:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.337608:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8270 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b67b expref: 26 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.337617:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.337659:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8270 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b67b expref: 26 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.337678:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8270 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b67b expref: 26 pid: 11515 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574482.337712:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5030bf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6512:1874407346809856:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574482.337814:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574482.342890:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.343590:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323638656 00000100:00100000:3.0:1787574482.343601:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323638656 00010000:00010000:3.0:1787574482.343644:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8270 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b67b expref: 27 pid: 11515 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574482.343691:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:3.0:1787574482.343701:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:2405:x1874407323638656:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574482.343717:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574482.343724:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8270 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b67b expref: 27 pid: 11515 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.343757:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8270 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b67b expref: 27 pid: 11515 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.343780:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca52057fb00) 00010000:00010000:3.0:1787574482.343786:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.343796:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.343804:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.343823:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574482.343886:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:2405:x1874407323638656:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 186us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574482.343894:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00010000:00010000:2.0:1787574482.352496:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb8270 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b67b expref: 26 pid: 11515 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574482.352548:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5030bf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6512:1874407346809856:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574482.352575:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.352585:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574482.352591:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574482.352810:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1787574482.353062:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1787574482.353168:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1874407346809984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787574482.353297:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574482.353404:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5203f30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574482.353515:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346809984 00000100:00100000:3.0:1787574482.353524:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346809984 00000100:00100000:3.0:1787574482.353615:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787574482.353627:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1874407346809984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787574482.353739:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1874407346809984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 113us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574482.353746:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787574482.353826:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca402506300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1874407346809984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787574482.353984:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1787574482.354030:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5030be680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1874407346810112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787574482.354060:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574482.354362:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574482.354546:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346810112 00000100:00100000:2.0:1787574482.354552:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346810112 00000100:00100000:2.0:1787574482.354580:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787574482.354588:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1874407346810112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787574482.354700:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1874407346810112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (628us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787574482.354708:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787574482.354975:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5030be680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1874407346810112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787574482.355023:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1787574482.355057:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.355067:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.355075:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.355081:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574482.355086:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.355093:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.355109:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca52057fb00) 00010000:00010000:1.0:1787574482.355112:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787574482.355201:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.355208:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb82e0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787574482.355338:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787574482.355401:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787574482.355413:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421538172130ns, next at 422538169767ns, rc = 0 00000001:00080000:1.0:1787574482.355419:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1787574482.355440:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca52057fb00) 00010000:00010000:1.0:1787574482.355443:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787574482.355450:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb82cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6a5 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574482.355550:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:11181:x1874407323638528:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 21864us (22076us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1787574482.355559:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000020:00080000:1.0:1787574482.355562:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787574482.358495:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.358728:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323638784 00000100:00100000:3.0:1787574482.358739:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323638784 00000100:00100000:3.0:1787574482.358802:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:3.0:1787574482.358814:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:11181:x1874407323638784:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574482.358851:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574482.359062:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb82e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.359125:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb82e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ac expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.359152:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb82e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ac expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.359170:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574482.359174:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574482.359177:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99e00, rc 0) 00000100:00100000:3.0:1787574482.359280:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:11181:x1874407323638784:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 468us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574482.359287:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:3.0:1787574482.363069:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574482.367986:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323639040 00000100:00100000:1.0:1787574482.368001:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323639040 00000100:00100000:1.0:1787574482.368070:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:1.0:1787574482.368080:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b65b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:11181:x1874407323639040:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1787574482.369798:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b65b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+31:11181:x1874407323639040:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 1710us (6730us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787574482.369811:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:1.0:1787574482.513072:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.513226:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323639296 00000100:00100000:3.0:1787574482.513237:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323639296 00000100:00100000:3.0:1787574482.513330:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:3.0:1787574482.513340:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+31:11191:x1874407323639296:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574482.513362:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574482.513382:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6b3 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574482.513492:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787574482.513600:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6b3 expref: 33 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.513630:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:3.0:1787574482.513633:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574482.513638:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6b3 expref: 33 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.513651:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99a00, rc 0) 00000100:00100000:3.0:1787574482.513717:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:11191:x1874407323639296:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 378us (655us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1787574482.513724:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:1.0:1787574482.522932:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.523037:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323639424 00000100:00100000:3.0:1787574482.523056:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323639424 00000100:00100000:3.0:1787574482.523114:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:3.0:1787574482.523125:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:11191:x1874407323639424:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:3.0:1787574482.523219:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523236:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523288:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523303:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8303 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523311:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8303 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523331:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8303 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523416:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb830a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523424:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb830a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523431:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb830a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574482.523481:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb830a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523494:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523500:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82fc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523507:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523512:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574482.523517:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523524:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523537:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574482.523546:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574482.523551:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523558:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb82fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523572:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8303 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523578:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8303 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523584:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8303 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523589:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be98c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574482.523592:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8303 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523598:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8303 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523606:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca52057f000) 00010000:00010000:3.0:1787574482.523608:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574482.523611:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8303 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523617:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8303 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523627:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb830a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523639:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb830a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523645:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb830a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523650:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574482.523654:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb830a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523660:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb830a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523668:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574482.523670:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574482.523673:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb830a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.523679:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb830a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574482.523748:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:11191:x1874407323639424:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 624us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574482.523757:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:1.0:1787574482.529891:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.529979:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323639680 00000100:00100000:3.0:1787574482.529989:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323639680 00000100:00100000:3.0:1787574482.530052:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1787574482.530063:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:11191:x1874407323639680:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1787574482.530316:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+33:11191:x1874407323639680:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 253us (434us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787574482.530337:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:0.0:1787574482.607440:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.607613:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323639936 00000100:00100000:3.0:1787574482.607625:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323639936 00000100:00100000:3.0:1787574482.607742:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:3.0:1787574482.607763:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+33:11194:x1874407323639936:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574482.607789:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574482.607810:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8311 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.607903:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8318 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.607932:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8318 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.607944:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8318 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.607956:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb831f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.607963:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb831f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.607969:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb831f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609193:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8326 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574482.609328:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574482.609372:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609382:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574482.609456:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787574482.609543:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8318 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609550:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8318 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609556:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8318 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609562:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574482.609566:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8318 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609574:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8318 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609587:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574482.609589:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574482.609593:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8318 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609600:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8318 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609614:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb831f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609626:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb831f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609631:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb831f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609636:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574482.609638:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb831f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609644:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb831f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609652:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca52057f000) 00010000:00010000:3.0:1787574482.609655:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574482.609657:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb831f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609663:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb831f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609711:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8311 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ba expref: 36 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609724:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8326 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ba expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574482.609732:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574482.609733:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574482.609743:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031a00, rc 0) 00000100:00100000:3.0:1787574482.610736:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:11194:x1874407323639936:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2977us (3354us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787574482.610746:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:0.0:1787574482.617437:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574482.617638:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323640064 00000100:00100000:1.0:1787574482.617649:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323640064 00000100:00100000:1.0:1787574482.617764:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1787574482.617776:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:11194:x1874407323640064:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:1.0:1787574482.617871:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb8334 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.617888:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb8334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.617899:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb8334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.617952:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb8334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.617960:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb8334 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.617967:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb8334 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.617973:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574482.617978:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb8334 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.617985:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb8334 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.617996:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574482.618000:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574482.618019:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb8334 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.618026:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb8334 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574482.618422:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:11194:x1874407323640064:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 646us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574482.618431:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1787574482.624390:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.624472:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323640320 00000100:00100000:3.0:1787574482.624482:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323640320 00000100:00100000:3.0:1787574482.624541:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1787574482.624552:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:11194:x1874407323640320:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1787574482.624833:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+36:11194:x1874407323640320:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 274us (445us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787574482.624841:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:0.0:1787574482.985614:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574482.985719:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323640576 00000100:00100000:1.0:1787574482.985730:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323640576 00000100:00100000:1.0:1787574482.985797:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:1.0:1787574482.985808:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40349e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+36:11225:x1874407323640576:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:1.0:1787574482.985834:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574482.985852:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb833b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6c1 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.985965:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8342 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.985979:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.985991:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574482.986003:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787574482.986129:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb833b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c1 expref: 39 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.986166:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8342 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c1 expref: 38 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.986175:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574482.986178:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574482.986181:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75200, rc 0) 00000100:00100000:1.0:1787574482.986317:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40349e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:11225:x1874407323640576:12345-192.168.202.40@tcp:101:cat.0 Request processed in 510us (714us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787574482.986324:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:0.0:1787574482.990413:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574482.990603:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323640832 00000100:00100000:3.0:1787574482.990614:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323640832 00000100:00100000:3.0:1787574482.990672:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1787574482.990683:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:11225:x1874407323640832:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:3.0:1787574482.990929:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:11225:x1874407323640832:12345-192.168.202.40@tcp:35:cat.0 Request processed in 247us (527us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1787574482.990937:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:2.0:1787574482.995434:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574482.995539:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323640960 00000100:00100000:1.0:1787574482.995549:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323640960 00000100:00100000:1.0:1787574482.995622:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1787574482.995634:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:2404:x1874407323640960:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574482.995651:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574482.995676:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8342 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c1 expref: 39 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574482.995691:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574482.995695:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574482.995751:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:2404:x1874407323640960:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574482.995759:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:0.0:1787574483.060041:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574483.060133:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323641216 00000100:00100000:3.0:1787574483.060143:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323641216 00000100:00100000:3.0:1787574483.060222:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1787574483.060235:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:11231:x1874407323641216:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:3.0:1787574483.060297:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574483.060301:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787574483.060329:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb82a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b697 expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.060366:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574483.060371:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574483.060386:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8350 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.060490:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.060505:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8326 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ba expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.060512:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.060545:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8326 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ba expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.060560:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8326 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ba expref: 38 pid: 6510 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574483.060574:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346810240:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574483.060664:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e240 going to sleep for 11 seconds 00000100:00080000:1.0:1787574483.061044:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574483.065044:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574483.065163:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346810240:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574483.065195:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574483.065406:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323641344 00000100:00100000:1.0:1787574483.065414:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323641344 00010000:00010000:1.0:1787574483.065468:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8326 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ba expref: 39 pid: 6510 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574483.065509:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:1.0:1787574483.065519:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:2405:x1874407323641344:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574483.065535:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574483.065542:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8326 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ba expref: 39 pid: 6510 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.065555:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8326 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ba expref: 39 pid: 6510 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.065577:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8326 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ba expref: 39 pid: 6510 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.065592:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574483.065598:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.065607:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.065614:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.065642:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574483.065698:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:2405:x1874407323641344:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 180us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574483.065705:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00010000:00010000:3.0:1787574483.065889:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.065902:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574483.065921:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787574483.066070:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8350 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c8 expref: 39 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.066085:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c8 expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.066093:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574483.066095:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574483.066098:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030800, rc 0) 00000100:00100000:3.0:1787574483.066136:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:11231:x1874407323641216:12345-192.168.202.40@tcp:101:dd.0 Request processed in 5905us (6113us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787574483.066143:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:0.0:1787574483.070742:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574483.070820:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323641472 00000100:00100000:1.0:1787574483.070830:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323641472 00000100:00100000:1.0:1787574483.070907:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:1.0:1787574483.070919:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:11231:x1874407323641472:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:1.0:1787574483.070945:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574483.070965:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8365 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.070999:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb836c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.071013:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb836c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.071024:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb836c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.071170:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8365 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6cf expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.071189:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb836c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6cf expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.071198:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574483.071201:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787574483.071215:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75c00, rc 0) 00000100:00100000:1.0:1787574483.071300:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:11231:x1874407323641472:12345-192.168.202.40@tcp:101:dd.0 Request processed in 382us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574483.071307:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:2.0:1787574483.075848:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574483.075984:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323641728 00000100:00100000:3.0:1787574483.075995:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323641728 00000100:00100000:3.0:1787574483.076057:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:3.0:1787574483.076068:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:11231:x1874407323641728:12345-192.168.202.40@tcp:36:dd.0 00010000:00010000:3.0:1787574483.076543:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.076561:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.076573:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787574483.076633:0:8610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1787574483.076656:0:8610:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001452cf8 reply state 00000000e94d6956 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.076667:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.076674:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574483.076676:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574483.076679:0:8610:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787574483.076804:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+42:11231:x1874407323641728:12345-192.168.202.40@tcp:36:dd.0 Request processed in 737us (966us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1787574483.076812:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000020:00080000:3.0:1787574483.076817:0:8610:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787574483.540351:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574483.540440:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323641856 00000100:00100000:3.0:1787574483.540450:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323641856 00000100:00100000:3.0:1787574483.540514:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:3.0:1787574483.540525:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+42:11246:x1874407323641856:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:3.0:1787574483.540553:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574483.540579:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb837a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.540660:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8381 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.540678:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8381 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.540692:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8381 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.540719:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8388 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.540727:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.540733:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.540812:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.540823:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c8 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.540832:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.540883:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c8 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.540898:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c8 expref: 43 pid: 6510 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574483.540926:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346810368:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574483.541034:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574483.545044:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574483.545277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323642112 00000100:00100000:2.0:1787574483.545286:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323642112 00000100:00100000:2.0:1787574483.545349:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:2.0:1787574483.545373:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+44:6177:x1874407323642112:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787574483.545665:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+45:6177:x1874407323642112:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 293us (639us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787574483.545673:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1787574483.545826:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346810368:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574483.545857:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574483.548328:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574483.548420:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323642240 00000100:00100000:1.0:1787574483.548430:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323642240 00010000:00010000:1.0:1787574483.548466:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c8 expref: 45 pid: 6510 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574483.548504:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:1.0:1787574483.548514:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+45:2405:x1874407323642240:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574483.548527:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574483.548533:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c8 expref: 45 pid: 6510 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.548546:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c8 expref: 45 pid: 6510 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.548567:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8357 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6c8 expref: 45 pid: 6510 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.548583:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574483.548588:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.548597:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.548605:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.548637:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574483.548688:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+44:2405:x1874407323642240:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 175us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574483.548706:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00010000:00010000:0.0:1787574483.549047:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549056:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574483.549101:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787574483.549104:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574483.549149:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549161:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549171:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8381 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549187:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8381 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549194:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8381 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549200:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574483.549213:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8381 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549220:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8381 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549230:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:0.0:1787574483.549233:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574483.549236:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8381 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549274:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8381 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549284:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549290:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8388 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549296:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8388 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549301:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574483.549309:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8388 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549315:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8388 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549323:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca52057f000) 00010000:00010000:0.0:1787574483.549325:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574483.549328:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8388 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549333:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8388 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549360:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb837a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6d6 expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549374:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6d6 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.549381:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574483.549383:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574483.549385:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031a00, rc 0) 00000100:00100000:0.0:1787574483.549424:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:11246:x1874407323641856:12345-192.168.202.40@tcp:101:stat.0 Request processed in 8902us (9085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574483.549431:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:2.0:1787574483.608115:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574483.608342:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323642496 00000100:00100000:1.0:1787574483.608353:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323642496 00000100:00100000:1.0:1787574483.608466:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1787574483.608478:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:11252:x1874407323642496:12345-192.168.202.40@tcp:36:truncate.0 00010000:00010000:1.0:1787574483.608538:0:11515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574483.608566:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb838f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6d6 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.608585:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574483.608590:0:11515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574483.608747:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.608760:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.608769:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574483.608813:0:11515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1787574483.608834:0:11515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9a8c36f reply state 000000008dff83a9 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.608847:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.608854:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574483.608857:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787574483.608872:0:11515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787574483.608967:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+45:11252:x1874407323642496:12345-192.168.202.40@tcp:36:truncate.0 Request processed in 490us (861us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787574483.608974:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000020:00080000:1.0:1787574483.608979:0:11515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787574483.633883:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574483.768901:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574483.769570:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323642624 00000100:00100000:3.0:1787574483.769582:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323642624 00000100:00100000:3.0:1787574483.769706:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:3.0:1787574483.769717:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+45:11266:x1874407323642624:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:3.0:1787574483.769741:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574483.769761:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb839d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6dd expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.769827:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.769842:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.769862:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.769874:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.769881:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.769887:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.769955:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.769983:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.769990:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574483.770043:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787574483.770049:0:8610:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574483.770071:0:8610:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770083:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770091:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770098:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770104:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770110:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574483.770124:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770132:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770143:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574483.770155:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574483.770160:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770167:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770181:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770186:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770192:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770197:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574483.770210:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770217:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770224:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca52057f000) 00010000:00010000:3.0:1787574483.770226:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574483.770229:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770235:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770301:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb839d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6dd expref: 47 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770326:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6dd expref: 46 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.770334:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574483.770336:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574483.770338:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030c00, rc 0) 00000100:00100000:3.0:1787574483.770784:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+46:11266:x1874407323642624:12345-192.168.202.40@tcp:101:stat.0 Request processed in 1066us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574483.770792:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:2.0:1787574483.868300:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574483.868483:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323642880 00000100:00100000:0.0:1787574483.868494:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323642880 00000100:00100000:0.0:1787574483.868559:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:0.0:1787574483.868570:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+46:11276:x1874407323642880:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574483.868599:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574483.868620:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb83b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574483.868716:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787574483.868825:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb83b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6e4 expref: 48 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.868853:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:0.0:1787574483.868857:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574483.868863:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb83b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6e4 expref: 48 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574483.868880:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11600, rc 0) 00000100:00100000:0.0:1787574483.868939:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+47:11276:x1874407323642880:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 371us (650us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1787574483.868946:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:0.0:1787574483.874183:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574483.874321:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323643136 00000100:00100000:2.0:1787574483.874333:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323643136 00000100:00100000:2.0:1787574483.874404:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:2.0:1787574483.874416:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+47:11276:x1874407323643136:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1787574483.874650:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+48:11276:x1874407323643136:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 236us (476us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1787574483.874658:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:2.0:1787574483.963286:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574483.965030:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323643392 00000100:00100000:1.0:1787574483.965047:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323643392 00000100:00100000:1.0:1787574483.965114:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:1.0:1787574483.965126:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+48:11282:x1874407323643392:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574483.965152:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574483.965174:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb83c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6eb expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.965321:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.965337:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6dd expref: 49 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.965347:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.965382:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6dd expref: 49 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.965396:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6dd expref: 49 pid: 8610 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574483.965409:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346810496:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574483.965544:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574483.972970:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574483.973282:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346810496:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574483.973309:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574483.973467:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323643520 00000100:00100000:3.0:1787574483.973476:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323643520 00010000:00010000:3.0:1787574483.973519:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6dd expref: 50 pid: 8610 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574483.973562:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:3.0:1787574483.973573:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b689450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+50:2404:x1874407323643520:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574483.973588:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574483.973596:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6dd expref: 50 pid: 8610 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.973609:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6dd expref: 50 pid: 8610 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.973633:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6dd expref: 50 pid: 8610 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.973671:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574483.973676:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.973687:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.973695:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.973716:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574483.973824:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b689450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+49:2404:x1874407323643520:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 251us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574483.973832:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00010000:00010000:1.0:1787574483.973955:0:11515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.973963:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574483.973982:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787574483.974127:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb83c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6eb expref: 50 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.974143:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6eb expref: 49 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574483.974150:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574483.974153:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787574483.974155:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19e00, rc 0) 00000100:00100000:1.0:1787574483.974180:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+49:11282:x1874407323643392:12345-192.168.202.40@tcp:101:bash.0 Request processed in 9057us (10948us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787574483.974188:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:2.0:1787574483.983520:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574483.983644:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323643776 00000100:00100000:3.0:1787574483.983653:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323643776 00000100:00100000:3.0:1787574483.983724:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:3.0:1787574483.983735:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+49:11282:x1874407323643776:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:3.0:1787574483.983970:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.983989:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.984000:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787574483.984041:0:8610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1787574483.984063:0:8610:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec9e25b3 reply state 00000000100eb418 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.984088:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.984096:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574483.984099:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574483.984102:0:8610:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787574483.984210:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+52:11282:x1874407323643776:12345-192.168.202.40@tcp:36:bash.0 Request processed in 468us (691us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1787574483.984217:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000020:00080000:3.0:1787574483.984223:0:8610:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787574483.992650:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574483.992783:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323643904 00000100:00100000:3.0:1787574483.992794:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323643904 00000100:00100000:3.0:1787574483.992863:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:3.0:1787574483.992875:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+52:11282:x1874407323643904:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1787574483.992900:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574483.992921:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb83e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.993032:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.993048:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6eb expref: 53 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.993056:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ea lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.993090:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6eb expref: 53 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574483.993122:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6eb expref: 53 pid: 11515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574483.993138:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346810624:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574483.993226:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787574484.002444:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346810624:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574484.002484:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574484.002593:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574484.002823:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323644032 00000100:00100000:1.0:1787574484.002831:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323644032 00010000:00010000:1.0:1787574484.002932:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6eb expref: 54 pid: 11515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574484.002993:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1787574484.003004:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+54:2404:x1874407323644032:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574484.003019:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574484.003027:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6eb expref: 54 pid: 11515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.003183:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6eb expref: 54 pid: 11515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.003215:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb83ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6eb expref: 54 pid: 11515 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.003234:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574484.003367:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.003378:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.003400:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ea lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.003429:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574484.003489:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+53:2404:x1874407323644032:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 486us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574484.003497:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00010000:00010000:3.0:1787574484.003722:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.003730:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574484.003788:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787574484.003793:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574484.003814:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.003858:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb83e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6f2 expref: 53 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.003875:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6f2 expref: 52 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.003884:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574484.003896:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574484.003899:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030a00, rc 0) 00000100:00100000:3.0:1787574484.003928:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+52:11282:x1874407323643904:12345-192.168.202.40@tcp:101:bash.0 Request processed in 11056us (11288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574484.003935:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1787574484.008450:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574484.008529:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323644288 00000100:00100000:1.0:1787574484.008553:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323644288 00000100:00100000:1.0:1787574484.008612:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:1.0:1787574484.008623:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b659050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+52:11282:x1874407323644288:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:1.0:1787574484.008852:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b659050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+53:11282:x1874407323644288:12345-192.168.202.40@tcp:35:bash.0 Request processed in 230us (413us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787574484.008860:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1787574484.121645:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574484.121803:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323644544 00000100:00100000:3.0:1787574484.121813:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323644544 00000100:00100000:3.0:1787574484.121881:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:3.0:1787574484.121892:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+53:11292:x1874407323644544:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574484.121916:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574484.121936:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b6f9 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574484.122032:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787574484.122330:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6f9 expref: 55 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.122346:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:3.0:1787574484.122349:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574484.122354:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb83f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6f9 expref: 55 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.122368:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031600, rc 0) 00000100:00100000:3.0:1787574484.122428:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+54:11292:x1874407323644544:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 539us (795us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1787574484.122436:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:3.0:1787574484.135676:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574484.135803:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323644672 00000100:00100000:0.0:1787574484.135814:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323644672 00000100:00100000:0.0:1787574484.135887:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:0.0:1787574484.135895:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+54:11292:x1874407323644672:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1787574484.135962:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb83ff lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.135975:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb83ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.135989:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb83ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.135999:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8406 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136003:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8406 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136007:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8406 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136088:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb840d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136097:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb840d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136103:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb840d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574484.136163:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb840d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136177:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb83ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136184:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb83ff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136191:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb83ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136232:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574484.136237:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb83ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136282:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb83ff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136295:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:0.0:1787574484.136298:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574484.136303:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb83ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136309:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb83ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136323:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8406 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136326:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8406 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136330:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8406 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136333:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574484.136335:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8406 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136338:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8406 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136354:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca52057f000) 00010000:00010000:0.0:1787574484.136357:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574484.136359:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8406 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136365:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8406 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136375:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb840d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136381:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb840d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136387:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb840d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136392:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574484.136395:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb840d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136400:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb840d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136408:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574484.136409:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574484.136412:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb840d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.136418:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb840d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574484.136494:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+54:11292:x1874407323644672:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 599us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574484.136503:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:2.0:1787574484.144069:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574484.144175:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323644928 00000100:00100000:1.0:1787574484.144185:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323644928 00000100:00100000:1.0:1787574484.144272:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1787574484.144284:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+54:11292:x1874407323644928:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1787574484.144516:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+55:11292:x1874407323644928:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 233us (464us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787574484.144524:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1787574484.285347:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574484.286075:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323645184 00000100:00100000:3.0:1787574484.286085:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323645184 00000100:00100000:3.0:1787574484.286162:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:3.0:1787574484.286173:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+55:11295:x1874407323645184:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574484.286209:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574484.286230:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8414 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b700 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286345:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb841b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286361:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb841b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286372:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb841b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286383:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8422 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286390:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8422 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286398:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8422 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286509:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8429 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286520:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8429 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286547:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8429 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574484.286556:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787574484.286632:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb841b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286640:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb841b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286646:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb841b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286652:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574484.286657:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb841b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286663:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb841b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286675:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574484.286678:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574484.286682:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb841b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286688:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb841b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286702:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8422 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286707:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8422 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286719:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8422 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286724:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574484.286727:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8422 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286734:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8422 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286743:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca52057f000) 00010000:00010000:3.0:1787574484.286745:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574484.286748:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8422 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286754:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8422 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286793:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8414 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b700 expref: 58 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286808:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8429 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b700 expref: 57 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.286815:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574484.286818:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574484.286820:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be98c00, rc 0) 00000100:00100000:3.0:1787574484.287312:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+57:11295:x1874407323645184:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1138us (1970us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787574484.287331:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:3.0:1787574484.293969:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574484.294075:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323645312 00000100:00100000:1.0:1787574484.294085:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323645312 00000100:00100000:1.0:1787574484.294153:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:1.0:1787574484.294164:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+57:11295:x1874407323645312:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:1.0:1787574484.294236:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb8437 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.294271:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb8437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.294283:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb8437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.294318:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb8437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.294342:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb8437 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.294349:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb8437 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.294355:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574484.294359:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb8437 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.294366:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb8437 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.294379:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574484.294382:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574484.294386:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb8437 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.294392:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb8437 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574484.294471:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+57:11295:x1874407323645312:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 308us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574484.294479:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:2.0:1787574484.296628:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574484.297665:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323645440 00000100:00100000:3.0:1787574484.297677:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323645440 00000100:00100000:3.0:1787574484.297749:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1787574484.297761:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+57:2404:x1874407323645440:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574484.297778:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574484.297802:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8429 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b700 expref: 57 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.297820:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574484.297825:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574484.297901:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+56:2404:x1874407323645440:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 142us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574484.297910:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:2.0:1787574484.300473:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574484.300587:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323645696 00000100:00100000:1.0:1787574484.300596:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323645696 00000100:00100000:1.0:1787574484.300647:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1787574484.300656:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+56:11295:x1874407323645696:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1787574484.300874:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+57:11295:x1874407323645696:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 217us (408us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787574484.300895:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1787574484.568526:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574484.568739:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323645952 00000100:00100000:1.0:1787574484.568756:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323645952 00000100:00100000:1.0:1787574484.568844:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:1.0:1787574484.568856:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+57:11313:x1874407323645952:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:1.0:1787574484.568882:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574484.568902:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb843e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b707 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.569002:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8445 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.569016:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8445 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.569027:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8445 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574484.569051:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787574484.569176:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb843e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b707 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.569206:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8445 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b707 expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574484.569215:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574484.569218:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787574484.569222:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e18e00, rc 0) 00000100:00100000:1.0:1787574484.569362:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+59:11313:x1874407323645952:12345-192.168.202.40@tcp:101:cat.0 Request processed in 509us (851us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1787574484.569370:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 74 00000001:00080000:2.0:1787574484.571395:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:2.0:1787574484.571450:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787574484.571470:0:6488:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ca40344b480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787574484.571476:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca4023bdb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ca40344b900 00000020:00080000:2.0:1787574484.571479:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca4023bd200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ca53be77400 00000020:00080000:3.0:1787574484.573263:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787574484.573459:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:0.0:1787574484.575615:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575634:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575641:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575647:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574484.575652:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575660:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575679:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ca52057f100) 00010000:00010000:0.0:1787574484.575682:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574484.575687:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575693:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb8223 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575715:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575737:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575742:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575747:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574484.575750:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575755:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575763:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:0.0:1787574484.575765:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574484.575768:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575773:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb822a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575788:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575794:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575800:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575805:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574484.575813:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575820:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575827:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca52057f000) 00010000:00010000:0.0:1787574484.575830:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574484.575833:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575839:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8269 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575856:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575861:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575866:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575871:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574484.575873:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575878:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575885:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574484.575887:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574484.575897:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575901:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8373 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575917:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575922:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575927:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575931:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574484.575933:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575938:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575944:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574484.575946:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574484.575948:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575953:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb8396 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575960:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575965:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575975:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575979:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574484.575982:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575987:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.575993:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574484.575995:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574484.575998:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.576002:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb83dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574484.577892:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346810752:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787574484.577967:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574484.579290:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346810752 00000100:00100000:2.0:1787574484.579301:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346810752 00000100:00100000:2.0:1787574484.579382:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787574484.579395:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346810752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787574484.579429:0:8423:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1787574484.579469:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8c38d1, atime: 0x6a8c38d1, ctime: 0x6a8c38d1, blocks: 0x8 00010000:00010000:2.0:1787574484.579477:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda06823/0xd18a1efeeddb8453 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574484.579494:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=423s v=(0 0) 00010000:00010000:2.0:1787574484.579498:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574484.579505:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda06823/0xd18a1efeeddb8453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574484.579523:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cda06823/0xd18a1efeeddb8453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574484.579533:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda06823/0xd18a1efeeddb8453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574484.579541:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cda06823/0xd18a1efeeddb8453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574484.579584:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787574484.579752:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1874407346810752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 361us (1783us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787574484.579761:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787574484.579839:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787574484.579922:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca40366f480/2, rc 0, transno 4294967302 00000100:00100000:3.0:1787574484.579929:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346810752:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787574484.580102:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574484.580236:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cda06823/0xd18a1efeeddb8453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.580272:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574484.580277:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda06823/0xd18a1efeeddb8453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.580287:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda06823/0xd18a1efeeddb8453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.580320:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cda06823/0xd18a1efeeddb8453 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.580329:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cda06823/0xd18a1efeeddb8453 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.580349:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574484.580351:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574484.580353:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574484.619090:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574484.619717:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323646080 00000100:00100000:3.0:1787574484.619729:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323646080 00000100:00100000:3.0:1787574484.620010:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:3.0:1787574484.620021:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:11314:x1874407323646080:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574484.620109:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574484.620130:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb845a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b70e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.620206:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8461 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.620220:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.620230:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574484.620291:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787574484.620295:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574484.620313:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.620340:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb845a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b70e expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.620356:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8461 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b70e expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.620365:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574484.620368:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574484.620372:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be99a00, rc 0) 00000100:00100000:3.0:1787574484.620529:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11314:x1874407323646080:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 511us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574484.620536:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:2.0:1787574484.626751:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574484.626812:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323646464 00000100:00100000:1.0:1787574484.626822:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323646464 00000100:00100000:1.0:1787574484.626946:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1787574484.626956:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11314:x1874407323646464:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1787574484.627431:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:11314:x1874407323646464:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 474us (685us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787574484.627439:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:2.0:1787574484.629884:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574484.629941:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323646592 00000100:00100000:0.0:1787574484.629951:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323646592 00000100:00100000:0.0:1787574484.630070:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:0.0:1787574484.630081:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:11314:x1874407323646592:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:0.0:1787574484.630096:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787574484.630119:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb83ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6f2 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.630140:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8445 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b707 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.630153:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb82e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6ac expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574484.630163:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574484.630168:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574484.630289:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:11314:x1874407323646592:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 210us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574484.630296:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:0.0:1787574484.634636:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574484.634702:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323646720 00000100:00100000:3.0:1787574484.634711:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323646720 00000100:00100000:3.0:1787574484.634750:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:3.0:1787574484.634757:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:11314:x1874407323646720:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:3.0:1787574484.634865:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8468 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.634877:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8468 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.634885:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8468 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574484.635090:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574484.635216:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787574484.635348:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787574484.635489:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:11314:x1874407323646720:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 730us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574484.635498:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00010000:00010000:1.0:1787574484.658027:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574484.659630:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574484.659680:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323646848 00000100:00100000:3.0:1787574484.659690:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323646848 00000100:00100000:3.0:1787574484.659858:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:3.0:1787574484.659870:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:11316:x1874407323646848:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574484.659890:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574484.659910:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb846f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b715 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.659972:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8476 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660003:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8476 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660015:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8476 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660048:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb847d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660056:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb847d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660063:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb847d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660144:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660152:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660159:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574484.660212:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787574484.660217:0:8610:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574484.660236:0:8610:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660266:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660286:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8476 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660293:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8476 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660300:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8476 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660306:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574484.660310:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8476 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660317:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8476 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660330:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574484.660333:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574484.660337:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8476 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660344:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8476 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660357:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb847d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660363:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb847d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660368:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb847d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660377:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574484.660380:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb847d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660385:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb847d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660393:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca50a599500) 00010000:00010000:3.0:1787574484.660395:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574484.660398:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb847d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660403:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb847d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660437:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb846f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b715 expref: 14 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660451:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b715 expref: 13 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574484.660458:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574484.660460:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574484.660462:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031e00, rc 0) 00000100:00100000:3.0:1787574484.660528:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:11316:x1874407323646848:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 660us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574484.660536:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:3.0:1787574484.722163:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574484.722208:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346810880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574484.722292:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574484.722355:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346810880 00000100:00100000:3.0:1787574484.722362:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346810880 00000100:00100000:3.0:1787574484.722414:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787574484.722424:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346810880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574484.722451:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574484.722494:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346810880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574484.722501:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787574484.722547:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346810880:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787574484.723162:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574484.723768:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346811008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574484.723818:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574484.724309:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346811008 00000100:00100000:3.0:1787574484.724316:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346811008 00000100:00100000:3.0:1787574484.724378:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787574484.724388:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346811008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574484.724405:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574484.724457:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346811008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574484.724465:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787574484.724900:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346811008:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787574484.725012:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787574485.105435:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574485.105444:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574485.105484:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787574485.105493:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787574485.105613:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca518b77480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346811136:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787574485.105703:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574485.109845:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca518b77480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346811136:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787574485.111804:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.112033:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323646976 00000100:00100000:3.0:1787574485.112044:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323646976 00000100:00100000:3.0:1787574485.112126:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:3.0:1787574485.112137:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:11327:x1874407323646976:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787574485.112167:0:6509:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787574485.112328:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:11327:x1874407323646976:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 192us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574485.112350:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00080000:1.0:1787574485.112701:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574485.125521:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574485.129176:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323647104 00000100:00100000:1.0:1787574485.129197:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323647104 00000100:00100000:1.0:1787574485.129439:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:1.0:1787574485.129451:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:11327:x1874407323647104:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787574485.129528:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb848b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129546:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb848b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129560:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb848b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129624:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8492 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129639:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8492 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129646:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8492 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129673:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8499 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129682:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8499 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129689:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8499 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574485.129814:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787574485.129818:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574485.129908:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8499 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129920:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb848b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129927:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb848b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129933:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb848b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129939:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574485.129944:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb848b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129956:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb848b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129967:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:1.0:1787574485.129970:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574485.129975:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb848b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129981:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb848b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129991:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8492 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.129997:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8492 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130003:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8492 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130008:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574485.130011:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8492 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130017:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8492 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130024:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9ca51874a900) 00010000:00010000:1.0:1787574485.130027:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574485.130029:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8492 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130045:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8492 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130061:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8499 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130068:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8499 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130074:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8499 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130078:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574485.130081:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8499 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130087:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8499 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130095:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574485.130097:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574485.130168:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8499 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.130175:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8499 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574485.130359:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:11327:x1874407323647104:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 908us (4846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574485.130366:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:0.0:1787574485.133540:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.133587:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323647360 00000100:00100000:3.0:1787574485.133596:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323647360 00000100:00100000:3.0:1787574485.133688:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:3.0:1787574485.133698:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:11327:x1874407323647360:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574485.133719:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574485.133748:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b71c expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.133853:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.133867:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.133884:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574485.133895:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787574485.133978:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.133986:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.133992:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.133999:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574485.134003:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.134015:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.134027:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574485.134030:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574485.134034:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.134039:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.134082:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84a0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b71c expref: 15 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.134091:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:3.0:1787574485.134093:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574485.134096:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b71c expref: 15 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.134118:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030c00, rc 0) 00000100:00100000:3.0:1787574485.134171:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11327:x1874407323647360:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 474us (638us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1787574485.134178:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:3.0:1787574485.137217:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.137273:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323647488 00000100:00100000:3.0:1787574485.137282:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323647488 00000100:00100000:3.0:1787574485.137330:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:3.0:1787574485.137340:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11327:x1874407323647488:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787574485.137380:0:6510:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787574485.137482:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11327:x1874407323647488:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 143us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574485.137489:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:3.0:1787574485.141487:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574485.141565:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323647744 00000100:00100000:2.0:1787574485.141573:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323647744 00000100:00100000:2.0:1787574485.141631:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:2.0:1787574485.141640:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11327:x1874407323647744:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574485.141659:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574485.141662:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787574485.141684:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8461 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b70e expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.141700:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:2.0:1787574485.141704:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574485.141717:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb84b5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b723 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787574485.142144:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787574485.142329:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.142344:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.142354:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.142407:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb84b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b723 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.142422:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b723 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.142429:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca520573400) 00010000:00010000:2.0:1787574485.142432:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574485.142434:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82a00, rc 0) 00000100:00100000:2.0:1787574485.142491:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:11327:x1874407323647744:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 851us (1013us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787574485.142499:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:2.0:1787574485.152426:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574485.152468:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323648000 00000100:00100000:2.0:1787574485.152478:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323648000 00000100:00100000:2.0:1787574485.152533:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:2.0:1787574485.152544:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:11327:x1874407323648000:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787574485.152620:0:8610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574485.152648:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b723 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.152665:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca520573400) 00010000:00010000:2.0:1787574485.152676:0:8610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574485.152696:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb84ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.152709:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb84ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.152718:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb84ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.152731:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb84d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x80f0a267 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.152739:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb84d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x80f0a267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.152745:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb84d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x80f0a267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.152794:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb84ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.152802:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb84ca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.152808:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb84ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.152820:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574485.152825:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb84ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.153303:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb84ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.153316:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:2.0:1787574485.153319:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574485.153323:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb84ca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.153329:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83000/0xd18a1efeeddb84ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.153340:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb84d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x80f0a267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.153346:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb84d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x80f0a267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.153352:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb84d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x80f0a267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.153357:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574485.153360:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb84d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x80f0a267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.153365:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb84d1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x80f0a267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.153383:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x80f0a267 (ffff9ca520573500) 00010000:00010000:2.0:1787574485.153386:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574485.153388:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb84d1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x80f0a267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.153394:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb84d1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x80f0a267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574485.153916:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11327:x1874407323648000:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 1371us (1496us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574485.153926:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:2.0:1787574485.160368:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.163346:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323648128 00000100:00100000:3.0:1787574485.163362:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323648128 00000100:00100000:3.0:1787574485.163462:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:3.0:1787574485.163473:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11327:x1874407323648128:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574485.163494:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574485.163517:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b72a expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.163551:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.163565:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.163577:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.163677:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b72a expref: 16 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.163693:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b72a expref: 15 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.163715:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:3.0:1787574485.163719:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787574485.163723:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030a00, rc 0) 00000100:00100000:3.0:1787574485.163799:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:11327:x1874407323648128:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 327us (3441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574485.163806:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:0.0:1787574485.171828:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574485.172097:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323648384 00000100:00100000:2.0:1787574485.172116:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323648384 00000100:00100000:2.0:1787574485.172173:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:2.0:1787574485.172184:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:11327:x1874407323648384:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787574485.172312:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.172330:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.172342:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787574485.172502:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1787574485.172512:0:6509:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424355270695ns, next at 425355268237ns, rc = 0 00000004:00010000:2.0:1787574485.172559:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a01b388 reply state 0000000066d671ea transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.172581:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.172589:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:2.0:1787574485.172591:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787574485.172595:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574485.172682:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:11327:x1874407323648384:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 499us (864us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787574485.172689:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:2.0:1787574485.180989:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.181340:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323648512 00000100:00100000:3.0:1787574485.181350:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323648512 00000100:00100000:3.0:1787574485.181402:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:3.0:1787574485.181413:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:11327:x1874407323648512:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574485.181437:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574485.181457:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b731 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.181514:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b731 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.181528:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b731 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.181545:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:3.0:1787574485.181549:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574485.181552:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030c00, rc 0) 00000100:00100000:3.0:1787574485.181614:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:11327:x1874407323648512:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 203us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574485.181631:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:2.0:1787574485.184820:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.184903:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323648640 00000100:00100000:3.0:1787574485.184912:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323648640 00000100:00100000:3.0:1787574485.184959:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1787574485.184967:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874407323648640:12345-192.168.202.40@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787574485.184998:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:3.0:1787574485.185051:0:8425:0:(genops.c:1385:class_connect()) connect: client 1aeb3668-c6f6-4338-ab9b-0a7c9161b421, cookie 0xd18a1efeeddb84f4 00002000:00100000:3.0:1787574485.185063:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1aeb3668-c6f6-4338-ab9b-0a7c9161b421/ffff9ca404109000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787574485.185074:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787574485.185152:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787574485.185178:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9ca40410a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574485.185269:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2401:x1874407323648640:12345-192.168.202.40@tcp:8:lhsmtool_posix.0 Request processed in 300us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574485.185277:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:2.0:1787574485.199621:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574485.200062:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323648768 00000100:00100000:0.0:1787574485.200072:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323648768 00000100:00100000:0.0:1787574485.200156:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:0.0:1787574485.200173:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:0:x1874407323648768:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787574485.200655:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787574485.201781:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1787574485.201793:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000100:00100000:2.0:1787574485.201960:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:0:x1874407323648768:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 1789us (2341us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787574485.201972:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:1.0:1787574485.206520:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.206592:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323649024 00000100:00100000:3.0:1787574485.206601:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323649024 00000100:00100000:3.0:1787574485.206658:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1787574485.206670:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:11327:x1874407323649024:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787574485.206903:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:11327:x1874407323649024:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 234us (391us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1787574485.206911:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:2.0:1787574485.219829:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.222461:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323649280 00000100:00100000:3.0:1787574485.222478:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323649280 00000100:00100000:0.0:1787574485.223747:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:0.0:1787574485.223759:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:11327:x1874407323649280:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787574485.223962:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:11327:x1874407323649280:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 204us (4144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574485.223970:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:2.0:1787574485.226300:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.226377:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323649408 00000100:00100000:3.0:1787574485.226401:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323649408 00000100:00100000:3.0:1787574485.226462:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:3.0:1787574485.226472:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:11327:x1874407323649408:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574485.226490:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574485.226508:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb84fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b738 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.226588:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8502 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.226601:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.226611:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574485.226653:0:8610:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574485.226670:0:8610:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.226694:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb84fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b738 expref: 21 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.226711:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b738 expref: 20 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.226719:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:3.0:1787574485.226722:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787574485.226726:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030800, rc 0) 00000100:00100000:3.0:1787574485.226780:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:11327:x1874407323649408:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 309us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574485.226792:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:1.0:1787574485.237843:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.237921:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323649536 00000100:00100000:3.0:1787574485.237931:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323649536 00000100:00100000:3.0:1787574485.237987:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:3.0:1787574485.237999:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323649536:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574485.238016:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574485.238037:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8509 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b73f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787574485.238062:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c38d4, blocks: 0x0 00010000:00010000:3.0:1787574485.238082:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=424s v=(0 0) 00010000:00010000:3.0:1787574485.238086:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574485.238096:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8509 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b73f expref: 6 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.238127:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8509 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b73f expref: 6 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.238141:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031600, rc 0) 00000100:00100000:3.0:1787574485.238211:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323649536:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 214us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574485.238218:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:0.0:1787574485.245044:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574485.245130:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323649792 00000100:00100000:1.0:1787574485.245140:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323649792 00000100:00100000:1.0:1787574485.245208:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:1.0:1787574485.245220:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:11327:x1874407323649792:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787574485.245345:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:11327:x1874407323649792:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 126us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574485.245352:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:0.0:1787574485.248439:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.248528:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323649920 00000100:00100000:3.0:1787574485.248537:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323649920 00000100:00100000:3.0:1787574485.248587:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:3.0:1787574485.248598:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:11327:x1874407323649920:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574485.248628:0:8619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574485.248647:0:8619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b746 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.248677:0:8619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8509 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b73f expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.248685:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574485.248690:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574485.248694:0:8619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 7 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.248725:0:8619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8509 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b73f expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.248738:0:8619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8509 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b73f expref: 7 pid: 8425 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.248754:0:8619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8619:1874407346811264:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574485.248851:0:8619:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574485.251424:0:8619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8619:1874407346811264:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574485.251457:0:8619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 7 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.251476:0:8619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031a00, rc 0) 00000100:00100000:3.0:1787574485.251543:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:11327:x1874407323649920:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 2946us (3114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574485.251551:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:0.0:1787574485.252765:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.252847:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323650048 00000100:00100000:3.0:1787574485.252856:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323650048 00010000:00010000:3.0:1787574485.252894:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8509 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b73f expref: 7 pid: 8425 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.252932:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1787574485.252942:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323650048:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574485.252957:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574485.252979:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8509 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b73f expref: 7 pid: 8425 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.252993:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8509 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b73f expref: 7 pid: 8425 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.253014:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8509 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b73f expref: 7 pid: 8425 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.253036:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574485.253041:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574485.253049:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 6 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.253059:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 6 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.253113:0:6494:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 6 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.253127:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6494:1874407346811392:192.168.202.40@tcp:105: 00000100:00100000:3.0:1787574485.253272:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574485.259662:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574485.259723:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323650176 00000100:00100000:1.0:1787574485.259733:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323650176 00002000:00100000:1.0:1787574485.259781:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9ca404054e00 x1874407323650176/t0(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:256/0 lens 504/0 e 0 to 0 dl 1787574496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787574485.259792:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404054e00 with x1874407323650176 ext(0->8) 00002000:00010000:1.0:1787574485.259797:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca404054e00 00000100:00100000:1.0:1787574485.259839:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:1.0:1787574485.259849:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323650176:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787574485.260424:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6494:1874407346811392:192.168.202.40@tcp:105: 00010000:00010000:1.0:1787574485.260449:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574485.260502:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2405:x1874407323650048:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 7560us (7742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574485.260510:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:1.0:1787574485.263394:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323650176:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 3537us (3730us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787574485.263408:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00002000:00100000:1.0:1787574485.263428:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9ca404054e00 x1874407323650176/t4294967303(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:256/0 lens 504/448 e 0 to 0 dl 1787574496 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787574485.263437:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404054e00 with x1874407323650176 ext(0->8) 00002000:00010000:1.0:1787574485.263443:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca404054e00 00000100:00100000:2.0:1787574485.271074:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.271198:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323650304 00000100:00100000:3.0:1787574485.271207:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323650304 00000100:00100000:3.0:1787574485.271278:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:3.0:1787574485.271288:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:11327:x1874407323650304:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787574485.273482:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1787574485.273501:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787574485.273529:0:6488:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1787574485.273660:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574485.273678:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346811520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787574485.273742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574485.273784:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346811520 00000100:00100000:2.0:1787574485.273789:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346811520 00000100:00100000:2.0:1787574485.273829:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787574485.273850:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346811520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787574485.273973:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787574485.273977:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787574484 00002000:00010000:2.0:1787574485.273979:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787574485.273981:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787574484 -> 1787574484 00002000:00010000:2.0:1787574485.273984:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787574485.274020:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346811520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (277us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787574485.274028:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1787574485.274084:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca404057100/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787574485.274090:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346811520:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787574485.274303:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.274314:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.274321:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.274327:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574485.274331:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.274338:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.274355:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:3.0:1787574485.274358:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787574485.274370:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.274377:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb84e6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787574485.274399:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787574485.274411:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787574485.274513:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11327:x1874407323650304:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 3224us (3447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574485.274520:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:3.0:1787574485.276655:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574485.277797:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323650432 00000100:00100000:2.0:1787574485.277808:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323650432 00000100:00100000:2.0:1787574485.277877:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:2.0:1787574485.277888:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323650432:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787574485.280756:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1787574485.280771:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1787574485.280930:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323650432:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 3038us (4277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574485.280941:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:3.0:1787574485.290429:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574485.290519:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323650688 00000100:00100000:0.0:1787574485.290529:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323650688 00000100:00100000:0.0:1787574485.290594:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:0.0:1787574485.290605:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11327:x1874407323650688:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574485.290660:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574485.290687:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8502 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b738 expref: 14 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.290706:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:0.0:1787574485.290712:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574485.290741:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.290753:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.290762:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574485.290895:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063c566b6 reply state 00000000d93c4216 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.290908:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.290914:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:0.0:1787574485.290916:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574485.290931:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574485.291018:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:11327:x1874407323650688:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 415us (598us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1787574485.291026:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:3.0:1787574485.295826:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574485.295919:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323650816 00000100:00100000:0.0:1787574485.295939:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323650816 00000100:00100000:0.0:1787574485.295996:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1787574485.296006:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323650816:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787574485.296170:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787574485.296173:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787574484 -> 1787574483 00002000:00010000:0.0:1787574485.296176:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787574481 00002000:00010000:0.0:1787574485.296178:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787574484 -> 1787574483 00002000:00010000:0.0:1787574485.296180:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787574485.296258:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323650816:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 236us (424us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787574485.296266:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:3.0:1787574485.305069:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574485.305203:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323651072 00000100:00100000:2.0:1787574485.305213:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323651072 00000100:00100000:2.0:1787574485.305301:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:2.0:1787574485.305313:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:11327:x1874407323651072:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787574485.305383:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.305400:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b72a expref: 15 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.305427:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.305461:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b72a expref: 15 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.305476:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b72a expref: 15 pid: 11515 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574485.305490:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346811648:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574485.305573:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca501254540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574485.314852:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574485.314956:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346811648:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574485.314985:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574485.315071:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323651200 00000100:00100000:0.0:1787574485.315079:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323651200 00010000:00010000:0.0:1787574485.315126:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b72a expref: 16 pid: 11515 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574485.315166:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:0.0:1787574485.315176:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403597b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:2404:x1874407323651200:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574485.315200:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574485.315208:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b72a expref: 16 pid: 11515 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.315268:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b72a expref: 16 pid: 11515 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.315292:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb84df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b72a expref: 16 pid: 11515 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.315308:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:0.0:1787574485.315313:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.315323:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.315331:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.315354:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574485.315403:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403597b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:2404:x1874407323651200:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 229us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574485.315412:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00010000:00010000:2.0:1787574485.315477:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.315485:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.315520:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.315526:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.315533:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.315545:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574485.315549:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.315556:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.315564:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:2.0:1787574485.315567:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787574485.315571:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.315577:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb851e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574485.315619:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11327:x1874407323651072:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 10309us (10560us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787574485.315627:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:0.0:1787574485.322214:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.322552:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323651328 00000100:00100000:3.0:1787574485.322563:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323651328 00000100:00100000:3.0:1787574485.322654:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:3.0:1787574485.322666:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323651328:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787574485.322712:0:8619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.322733:0:8619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 7 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.322742:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574485.322746:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574485.322752:0:8619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.322802:0:8619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 7 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.322816:0:8619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 7 pid: 8619 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.322843:0:8619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403594700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8619:1874407346811776:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574485.322931:0:8619:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787574485.326296:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574485.326388:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323651456 00000100:00100000:1.0:1787574485.326397:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323651456 00010000:00010000:1.0:1787574485.326439:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 8 pid: 8619 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574485.326480:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:1.0:1787574485.326491:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323651456:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574485.326506:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574485.326530:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 8 pid: 8619 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.326545:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 8 pid: 8619 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.326570:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574485.326575:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574485.326581:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.326609:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.326632:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574485.326688:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323651456:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 198us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574485.326696:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00010000:00010000:3.0:1787574485.327975:0:8619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8510 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b746 expref: 7 pid: 8619 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.327996:0:8619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403594700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8619:1874407346811776:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574485.328019:0:8619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.328043:0:8619:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.328051:0:8619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.328074:0:8619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.328109:0:8619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.328119:0:8619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.328126:0:8619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574485.328130:0:8619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.328140:0:8619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.328155:0:8619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.328162:0:8619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051b061ba/0xd18a1efeeddb8525 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.328266:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323651328:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 5601us (6061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574485.328275:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:0.0:1787574485.331024:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.331140:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323651712 00000100:00100000:3.0:1787574485.331150:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323651712 00000100:00100000:3.0:1787574485.331215:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:3.0:1787574485.331278:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11327:x1874407323651712:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787574485.331371:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.331390:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb836c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6cf expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.331400:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.331436:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb836c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6cf expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.331449:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb836c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6cf expref: 14 pid: 6511 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.331464:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346811904:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574485.331551:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574485.335135:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574485.335289:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323651840 00000100:00100000:0.0:1787574485.335299:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323651840 00010000:00010000:0.0:1787574485.335340:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb836c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6cf expref: 15 pid: 6511 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574485.335400:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:0.0:1787574485.335411:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:2404:x1874407323651840:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574485.335426:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574485.335434:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb836c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6cf expref: 15 pid: 6511 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.335448:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb836c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6cf expref: 15 pid: 6511 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.335471:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574485.335476:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.335486:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.335493:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.335511:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574485.335561:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:2404:x1874407323651840:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 151us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574485.335568:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00010000:00010000:3.0:1787574485.335952:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75c00/0xd18a1efeeddb836c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b6cf expref: 14 pid: 6511 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.335968:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346811904:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574485.335990:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.335998:0:11515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.336015:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.336213:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.336225:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b731 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.336234:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.336281:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b731 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.336294:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b731 expref: 14 pid: 6510 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.336308:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346812032:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574485.336358:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787574485.339038:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346812032:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574485.339068:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574485.341524:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574485.341617:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323651968 00000100:00100000:1.0:1787574485.341625:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323651968 00010000:00010000:1.0:1787574485.341665:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b731 expref: 15 pid: 6510 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574485.341707:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:1.0:1787574485.341719:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:2404:x1874407323651968:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574485.341733:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574485.341740:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b731 expref: 15 pid: 6510 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.341753:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b731 expref: 15 pid: 6510 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.341774:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb84ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b731 expref: 15 pid: 6510 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.341790:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:1.0:1787574485.341809:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.341818:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.341825:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.341865:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574485.341918:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:2404:x1874407323651968:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 201us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574485.341926:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00010000:00010000:3.0:1787574485.342052:0:11515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.342060:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787574485.342172:0:11515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1787574485.342329:0:11515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1787574485.342365:0:11515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1787574485.342441:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11515:1874407346812160:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787574485.342489:0:11515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574485.342513:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787574485.342989:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346812160 00000100:00100000:1.0:1787574485.342995:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346812160 00000100:00100000:1.0:1787574485.343041:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787574485.343049:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11515:x1874407346812160:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787574485.343139:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11515:x1874407346812160:12345-0@lo:1000:mdt00_004.0 Request processed in 90us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574485.343145:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787574485.343227:0:11515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787574485.343232:0:11515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca404057100, transno 4294967304 00000100:00100000:3.0:1787574485.343278:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11515:1874407346812160:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787574485.343398:0:11515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1787574485.343446:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11515:1874407346812288:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787574485.343475:0:11515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574485.343494:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574485.343510:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346812288 00000100:00100000:3.0:1787574485.343514:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346812288 00000100:00100000:3.0:1787574485.343540:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787574485.343547:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11515:x1874407346812288:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787574485.343644:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11515:x1874407346812288:12345-0@lo:1000:mdt00_004.0 Request processed in 97us (167us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787574485.343651:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787574485.343681:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403595f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11515:1874407346812288:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787574485.343711:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.343720:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.343742:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.343748:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574485.343752:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.343761:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.343774:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:3.0:1787574485.343777:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574485.343781:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.343787:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8533 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.343815:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8468 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.343821:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8468 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.343826:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8468 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.344344:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be98c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574485.344349:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8468 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.344367:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8468 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.344378:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574485.344381:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574485.344385:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8468 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.344391:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8468 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.344420:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.344435:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b715 expref: 17 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.344443:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.344473:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b715 expref: 17 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.344486:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b715 expref: 17 pid: 8610 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.344496:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403597b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346812416:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574485.344560:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebe780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574485.349857:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574485.349936:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323652096 00000100:00100000:0.0:1787574485.349946:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323652096 00010000:00010000:0.0:1787574485.349988:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b715 expref: 18 pid: 8610 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574485.350061:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:0.0:1787574485.350072:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:2405:x1874407323652096:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574485.350087:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574485.350095:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b715 expref: 18 pid: 8610 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.350119:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b715 expref: 18 pid: 8610 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.350142:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574485.350147:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.350156:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.350163:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.350194:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574485.350282:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:2405:x1874407323652096:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 211us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574485.350290:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00010000:00010000:3.0:1787574485.350943:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8484 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b715 expref: 17 pid: 8610 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.350968:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403597b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346812416:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574485.350989:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.350997:0:11515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351002:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351013:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351020:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351026:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351041:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574485.351045:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351052:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351063:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574485.351066:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574485.351070:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351082:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb853a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351093:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351109:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351115:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351120:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574485.351123:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351129:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351137:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574485.351139:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787574485.351141:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.351147:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb852c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.351719:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:11327:x1874407323651712:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 20480us (20700us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787574485.351728:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 93 00000020:00080000:3.0:1787574485.351742:0:11515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787574485.351864:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574485.351869:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574485.351884:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787574485.351891:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787574485.356471:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.356560:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323652352 00000100:00100000:3.0:1787574485.356570:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323652352 00000100:00100000:3.0:1787574485.356626:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1787574485.356637:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:11327:x1874407323652352:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787574485.357002:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787574485.357366:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1787574485.357406:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8541 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.357422:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8541 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.357434:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8541 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.357442:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8541 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.357448:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8541 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.357454:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8541 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.357514:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787574485.357609:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:11327:x1874407323652352:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 972us (1148us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787574485.357618:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000020:00080000:3.0:1787574485.357623:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787574485.366442:0:13731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574485.366461:0:13731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8541 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.366473:0:13731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574485.366479:0:13731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8541 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.366488:0:13731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8541 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.366508:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:0.0:1787574485.366511:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787574485.366517:0:13731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8541 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.366523:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8541 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.366549:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574485.366551:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574485.366553:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787574485.543487:0:14208:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574485.543498:0:14208:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574485.543521:0:14208:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787574485.543526:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787574485.693577:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574485.795637:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.798927:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323652608 00000100:00100000:3.0:1787574485.798941:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323652608 00000100:00100000:0.0:1787574485.799082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:0.0:1787574485.799093:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:11337:x1874407323652608:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574485.799115:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574485.799133:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b74d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.799234:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb854f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.799281:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb854f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.799291:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb854f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574485.799303:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787574485.799395:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b74d expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.799409:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb854f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b74d expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.799417:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:0.0:1787574485.799420:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787574485.799424:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10a00, rc 0) 00000100:00100000:0.0:1787574485.799482:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:11337:x1874407323652608:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 391us (3857us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787574485.799490:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:1.0:1787574485.805205:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.805293:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323652736 00000100:00100000:3.0:1787574485.805302:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323652736 00000100:00100000:3.0:1787574485.805356:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:3.0:1787574485.805365:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:11337:x1874407323652736:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:3.0:1787574485.805434:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb855d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805450:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb855d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805462:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb855d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805475:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8564 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805482:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805489:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805552:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb856b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805559:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb856b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805565:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb856b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574485.805618:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb856b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805631:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb855d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805637:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb855d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805644:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb855d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805649:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574485.805653:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb855d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805660:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb855d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805670:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574485.805673:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574485.805677:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb855d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805683:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb855d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805695:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805700:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8564 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805710:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8564 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805715:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574485.805718:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8564 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805724:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8564 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805730:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca50a599000) 00010000:00010000:3.0:1787574485.805732:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574485.805735:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8564 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805740:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8564 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805753:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb856b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805759:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb856b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805765:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb856b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805769:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574485.805772:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb856b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805785:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb856b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805791:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599d00) 00010000:00010000:3.0:1787574485.805793:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574485.805796:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb856b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.805801:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb856b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574485.805875:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:11337:x1874407323652736:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 511us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574485.805882:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:0.0:1787574485.845949:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.846040:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323652992 00000100:00100000:3.0:1787574485.846051:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323652992 00000100:00100000:3.0:1787574485.846111:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:3.0:1787574485.846125:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:11340:x1874407323652992:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574485.846145:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574485.846164:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8572 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b754 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846272:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8579 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846287:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8579 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846300:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8579 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846327:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8580 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846334:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8580 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846340:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8580 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846453:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8587 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846461:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846466:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574485.846476:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787574485.846552:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8579 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846560:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8579 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846567:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8579 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846573:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574485.846577:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8579 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846595:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8579 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846609:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574485.846612:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574485.846616:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8579 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846622:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8579 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846635:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8580 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846642:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8580 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846648:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8580 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846653:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574485.846656:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8580 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846662:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8580 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846669:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca50a599d00) 00010000:00010000:3.0:1787574485.846671:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574485.846674:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8580 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846689:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8580 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846730:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8572 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b754 expref: 23 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846744:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b754 expref: 22 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.846752:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574485.846754:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574485.846756:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030a00, rc 0) 00000100:00100000:3.0:1787574485.846810:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:11340:x1874407323652992:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 689us (870us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787574485.846818:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:3.0:1787574485.850938:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574485.851097:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323653120 00000100:00100000:2.0:1787574485.851109:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323653120 00000100:00100000:2.0:1787574485.851169:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:2.0:1787574485.851189:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:11340:x1874407323653120:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1787574485.851291:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8595 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.851308:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8595 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.851334:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8595 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.851371:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8595 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.851378:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8595 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.851385:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8595 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.851391:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574485.851396:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8595 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.851404:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8595 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.851416:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:2.0:1787574485.851419:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574485.851423:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8595 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.851429:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb8595 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574485.851498:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:11340:x1874407323653120:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 320us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574485.851505:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:1.0:1787574485.859920:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574485.860025:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323653376 00000100:00100000:2.0:1787574485.860047:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323653376 00000100:00100000:2.0:1787574485.860118:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1787574485.860129:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b658450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:11340:x1874407323653376:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1787574485.860411:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b658450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:11340:x1874407323653376:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 283us (499us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787574485.860419:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1787574485.893382:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574485.893484:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323653632 00000100:00100000:1.0:1787574485.893494:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323653632 00000100:00100000:1.0:1787574485.893602:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:1.0:1787574485.893627:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:10866:x1874407323653632:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574485.893652:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574485.893672:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb859c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b75b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.893783:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.893797:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8587 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b754 expref: 24 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.893806:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.893852:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b754 expref: 24 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.893865:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8587 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b754 expref: 24 pid: 11515 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574485.893877:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5030bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346812544:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574485.893974:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574485.896159:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5030bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346812544:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574485.896194:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574485.896980:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574485.897052:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323653760 00000100:00100000:1.0:1787574485.897059:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323653760 00010000:00010000:1.0:1787574485.897089:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8587 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b754 expref: 25 pid: 11515 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574485.897132:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:1.0:1787574485.897142:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:2404:x1874407323653760:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574485.897167:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574485.897172:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8587 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b754 expref: 25 pid: 11515 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.897195:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b754 expref: 25 pid: 11515 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.897216:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8587 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b754 expref: 25 pid: 11515 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.897232:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574485.897237:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.897295:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.897302:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.897326:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574485.897370:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:2404:x1874407323653760:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 229us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574485.897377:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00010000:00010000:3.0:1787574485.897645:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.897716:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574485.897841:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787574485.897963:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb859c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b75b expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.897980:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b75b expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574485.897998:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574485.898001:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574485.898003:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19800, rc 0) 00000100:00100000:3.0:1787574485.898115:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:10866:x1874407323653632:12345-192.168.202.40@tcp:101:bash.0 Request processed in 4490us (4740us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1787574485.898122:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:0.0:1787574485.900475:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574485.900563:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323653888 00000100:00100000:1.0:1787574485.900574:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323653888 00000100:00100000:1.0:1787574485.900653:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:1.0:1787574485.900663:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:10866:x1874407323653888:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574485.900692:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574485.900711:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb85b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b762 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.900742:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb85b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.900755:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb85b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.900766:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb85b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.900871:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb85b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b762 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.900889:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb85b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b762 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574485.900898:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574485.900901:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787574485.900904:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19e00, rc 0) 00000100:00100000:1.0:1787574485.900953:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:10866:x1874407323653888:12345-192.168.202.40@tcp:101:bash.0 Request processed in 292us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574485.900958:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:1.0:1787574485.903224:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574485.903363:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323654144 00000100:00100000:2.0:1787574485.903373:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323654144 00000100:00100000:2.0:1787574485.903559:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:2.0:1787574485.903570:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:10866:x1874407323654144:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:2.0:1787574485.903780:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.903793:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.903800:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574485.903832:0:8610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1787574485.903852:0:8610:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5abb1a6 reply state 000000007ad216c7 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.903864:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.903871:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:2.0:1787574485.903874:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787574485.903877:0:8610:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787574485.903910:0:8610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1787574485.903995:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:10866:x1874407323654144:12345-192.168.202.40@tcp:36:bash.0 Request processed in 426us (780us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787574485.904002:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 100 00000020:00080000:2.0:1787574485.904007:0:8610:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787574485.905965:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574485.906002:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323654272 00000100:00100000:3.0:1787574485.906013:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323654272 00000100:00100000:3.0:1787574485.906195:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:3.0:1787574485.906206:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:10866:x1874407323654272:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1787574485.906227:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574485.906629:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb85c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b769 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.906752:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb85c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b769 expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.906763:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb85c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b769 expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.906777:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:2.0:1787574485.906779:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574485.906781:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82e00, rc 0) 00000100:00100000:2.0:1787574485.906830:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:10866:x1874407323654272:12345-192.168.202.40@tcp:101:bash.0 Request processed in 627us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574485.906837:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:0.0:1787574485.908997:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574485.909109:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323654400 00000100:00100000:2.0:1787574485.909119:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323654400 00000100:00100000:2.0:1787574485.909206:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:2.0:1787574485.909217:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:10866:x1874407323654400:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574485.909232:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574485.909284:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000987c9c01/0xd18a1efeeddb85cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b770 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574485.909329:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c38d3, atime: 0x6a8c38d1, ctime: 0x6a8c38d3, blocks: 0x8 00010000:00010000:2.0:1787574485.909350:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1787574485.909354:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574485.909362:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000987c9c01/0xd18a1efeeddb85cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b770 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.909380:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000987c9c01/0xd18a1efeeddb85cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b770 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574485.909499:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83000, rc 0) 00000100:00100000:2.0:1787574485.909575:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:10866:x1874407323654400:12345-192.168.202.40@tcp:101:bash.0 Request processed in 361us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574485.909580:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:1.0:1787574485.911765:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574485.911824:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323654528 00000100:00100000:2.0:1787574485.911833:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323654528 00002000:00010000:2.0:1787574485.911870:0:8429:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1787574485.911874:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca402506300 with x1874407323654528 ext(0->18446744073709551615) 00002000:00010000:2.0:1787574485.911884:0:8429:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca402506300. 00000100:00100000:2.0:1787574485.911911:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:2.0:1787574485.911920:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323654528:12345-192.168.202.40@tcp:10:bash.0 00002000:00010000:2.0:1787574485.912444:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787574485.912447:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787574483 -> 1787574485 00002000:00010000:2.0:1787574485.912449:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787574481 -> 1787574481 00002000:00010000:2.0:1787574485.912450:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787574483 -> 1787574485 00002000:00010000:2.0:1787574485.912459:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787574485.912506:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323654528:12345-192.168.202.40@tcp:10:bash.0 Request processed in 586us (749us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787574485.912514:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00002000:00010000:2.0:1787574485.912518:0:8429:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1787574485.912520:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca402506300 with x1874407323654528 ext(0->18446744073709551615) 00002000:00010000:2.0:1787574485.912526:0:8429:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca402506300. 00000100:00100000:1.0:1787574485.998540:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574485.998650:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323654656 00000100:00100000:0.0:1787574485.998661:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323654656 00000100:00100000:0.0:1787574485.998720:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 102 00000100:00100000:0.0:1787574485.998731:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:11354:x1874407323654656:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1787574485.998797:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb85d4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.998813:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb85d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.998834:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb85d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.998850:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb85db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.998857:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb85db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.998864:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb85db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.998935:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb85e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.998945:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb85e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.998951:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb85e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574485.999015:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb85e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999026:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb85d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999032:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb85d4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999039:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb85d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999045:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574485.999049:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb85d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999056:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb85d4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999067:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:0.0:1787574485.999070:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574485.999075:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb85d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999080:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb85d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999103:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb85db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999110:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb85db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999122:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb85db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999127:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574485.999130:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb85db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999137:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb85db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999145:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca534a4c500) 00010000:00010000:0.0:1787574485.999147:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574485.999150:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb85db lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999155:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb85db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999169:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb85e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999176:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb85e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999192:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb85e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999197:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574485.999199:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb85e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999215:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb85e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999223:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574485.999225:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574485.999228:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb85e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574485.999233:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb85e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574485.999359:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:11354:x1874407323654656:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 629us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574485.999367:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 102 00000100:00100000:0.0:1787574486.033438:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.034732:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323654912 00000100:00100000:2.0:1787574486.034746:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323654912 00000100:00100000:2.0:1787574486.034821:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:2.0:1787574486.034831:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:11357:x1874407323654912:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574486.034853:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574486.034872:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb85e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b777 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.034965:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb85f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.034981:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb85f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.034992:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb85f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035007:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb85f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035013:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb85f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035036:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb85f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035150:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb85fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035161:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb85fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035168:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb85fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574486.035176:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787574486.035295:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb85f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035303:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb85f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035309:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb85f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035315:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574486.035320:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb85f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035327:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb85f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035340:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:2.0:1787574486.035343:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574486.035354:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb85f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035360:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83200/0xd18a1efeeddb85f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035372:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb85f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035379:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb85f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035397:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb85f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035403:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574486.035406:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb85f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035412:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb85f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035420:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca520573100) 00010000:00010000:2.0:1787574486.035422:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574486.035425:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb85f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035430:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83c00/0xd18a1efeeddb85f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035473:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83800/0xd18a1efeeddb85e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b777 expref: 33 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035499:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb85fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b777 expref: 32 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.035507:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:2.0:1787574486.035510:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787574486.035512:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82a00, rc 0) 00000100:00100000:2.0:1787574486.035584:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:11357:x1874407323654912:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 754us (2156us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787574486.035592:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:1.0:1787574486.045430:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.045551:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323655040 00000100:00100000:2.0:1787574486.045562:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323655040 00000100:00100000:2.0:1787574486.045672:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:2.0:1787574486.045684:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5350e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:11357:x1874407323655040:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1787574486.045780:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.045797:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b75b expref: 32 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.045808:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.046034:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b75b expref: 32 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.046052:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b75b expref: 32 pid: 6510 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574486.046075:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404057800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346812672:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574486.046281:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca501254540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574486.051123:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.051218:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323655296 00000100:00100000:3.0:1787574486.051227:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323655296 00000100:00100000:3.0:1787574486.051307:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1787574486.051317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+33:6177:x1874407323655296:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787574486.051600:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:6177:x1874407323655296:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 283us (487us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787574486.051607:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:1.0:1787574486.054402:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574486.054499:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323655424 00000100:00100000:0.0:1787574486.054508:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323655424 00010000:00010000:0.0:1787574486.054547:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b75b expref: 34 pid: 6510 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574486.054590:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:0.0:1787574486.054600:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:2405:x1874407323655424:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574486.054614:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574486.054622:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b75b expref: 34 pid: 6510 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.054636:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b75b expref: 34 pid: 6510 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.054690:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574486.054696:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.054707:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.054715:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.054747:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574486.054808:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:2405:x1874407323655424:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 210us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.054815:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00010000:00010000:2.0:1787574486.056090:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb85a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b75b expref: 33 pid: 6510 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574486.056120:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404057800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346812672:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574486.056142:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.056153:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.056159:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.056207:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.056215:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.056222:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.056227:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabc00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574486.056231:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.056264:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.056292:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:2.0:1787574486.056295:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574486.056299:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.056306:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb860c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574486.056374:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5350e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:11357:x1874407323655040:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 10691us (10954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574486.056382:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:1.0:1787574486.065188:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.065514:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323655680 00000100:00100000:3.0:1787574486.065525:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323655680 00000100:00100000:3.0:1787574486.065572:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1787574486.065581:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:11357:x1874407323655680:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1787574486.065801:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+33:11357:x1874407323655680:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 221us (633us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787574486.065838:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1787574486.136533:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.136609:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323655936 00000100:00100000:3.0:1787574486.136618:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323655936 00000100:00100000:3.0:1787574486.136679:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:3.0:1787574486.136689:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+33:11368:x1874407323655936:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:3.0:1787574486.136807:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574486.136828:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8613 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b77e expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.136898:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb861a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.136909:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb861a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.136916:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb861a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.136925:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8621 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.136930:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.136933:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137022:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8628 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137060:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137068:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574486.137077:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787574486.137155:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb861a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137160:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb861a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137165:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb861a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137169:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574486.137172:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb861a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137177:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb861a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137199:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574486.137202:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574486.137210:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb861a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137217:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb861a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137230:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137479:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8621 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137483:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137487:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574486.137488:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137492:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8621 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137498:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca50a599d00) 00010000:00010000:3.0:1787574486.137500:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574486.137502:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8621 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137506:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8621 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137539:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8613 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b77e expref: 36 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137548:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b77e expref: 35 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.137552:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574486.137554:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574486.137562:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030a00, rc 0) 00000100:00100000:3.0:1787574486.137615:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:11368:x1874407323655936:12345-192.168.202.40@tcp:101:cat.0 Request processed in 929us (1092us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787574486.137621:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:1.0:1787574486.140455:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.140534:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323656192 00000100:00100000:3.0:1787574486.140544:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323656192 00000100:00100000:3.0:1787574486.140591:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1787574486.140598:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:11368:x1874407323656192:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:3.0:1787574486.140853:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+36:11368:x1874407323656192:12345-192.168.202.40@tcp:35:cat.0 Request processed in 253us (406us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787574486.140861:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:1.0:1787574486.159430:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.159522:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323656448 00000100:00100000:2.0:1787574486.159531:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323656448 00000100:00100000:2.0:1787574486.159581:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 106 00000100:00100000:2.0:1787574486.159588:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+36:11369:x1874407323656448:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:2.0:1787574486.159639:0:8610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787574486.159663:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82e00/0xd18a1efeeddb85c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b769 expref: 36 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159686:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8628 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b77e expref: 35 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159700:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82a00/0xd18a1efeeddb85fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b777 expref: 34 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159712:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb85b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b762 expref: 33 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159740:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:2.0:1787574486.159745:0:8610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574486.159766:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8636 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159777:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159785:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159794:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159799:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159803:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159875:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8644 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159883:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8644 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.159888:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8644 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787574486.160058:0:8610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00010000:00010000:2.0:1787574486.160335:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb864b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160351:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb864b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160359:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb864b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160366:0:8610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb864b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160373:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb864b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160379:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb864b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160444:0:8610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574486.160464:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8644 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160468:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8644 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160472:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8644 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160476:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574486.160478:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8644 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160482:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8644 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160497:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:2.0:1787574486.160499:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787574486.160501:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8644 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160505:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8644 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160515:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160519:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8636 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160522:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8636 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160525:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabc00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574486.160527:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8636 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160530:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8636 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160533:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:2.0:1787574486.160535:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574486.160536:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8636 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160539:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8636 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787574486.160552:0:8610:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1452c48 reply state 00000000ecb6ab19 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160559:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.160563:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca520573100) 00010000:00010000:2.0:1787574486.160564:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787574486.160566:0:8610:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574486.160629:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:11369:x1874407323656448:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1040us (1211us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787574486.160635:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 106 00010000:00010000:0.0:1787574486.167213:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574486.167228:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb864b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.167264:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574486.167271:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb864b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.167281:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb864b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.167302:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574486.167305:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787574486.167310:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb864b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.167341:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb864b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.167364:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574486.167366:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574486.167368:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574486.214816:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.214914:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323656704 00000100:00100000:2.0:1787574486.214924:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323656704 00000100:00100000:2.0:1787574486.214976:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:2.0:1787574486.214984:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:11375:x1874407323656704:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574486.215005:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574486.215024:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8652 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b785 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215133:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8659 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215147:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8659 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215157:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8659 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215193:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215201:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215207:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787574486.215530:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787574486.215632:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8667 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215639:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8667 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215643:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8667 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215674:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8659 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215680:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8659 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215686:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8659 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215692:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574486.215695:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8659 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215713:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8659 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215725:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:2.0:1787574486.215727:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574486.215730:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8659 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215734:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8659 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787574486.215745:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023c402d7 reply state 00000000e86ce69e transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215751:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215755:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca520573100) 00010000:00010000:2.0:1787574486.215757:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787574486.215758:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787574486.215778:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8652 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b785 expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215789:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8667 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b785 expref: 36 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.215793:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573b00) 00010000:00010000:2.0:1787574486.215795:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574486.215796:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faac00, rc 0) 00000100:00100000:2.0:1787574486.215862:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:11375:x1874407323656704:12345-192.168.202.40@tcp:101:bash.0 Request processed in 877us (1054us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787574486.215875:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:1.0:1787574486.220378:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.220475:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323656832 00000100:00100000:2.0:1787574486.220483:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323656832 00000100:00100000:2.0:1787574486.220541:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:2.0:1787574486.220549:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2402:x1874407323656832:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574486.220563:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574486.220578:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000724c862e/0xd18a1efeeddb8675 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b78c expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574486.220597:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574486.220611:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1787574486.220614:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574486.220620:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000724c862e/0xd18a1efeeddb8675 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b78c expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.220632:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000724c862e/0xd18a1efeeddb8675 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b78c expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.220641:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faae00, rc 0) 00000100:00100000:2.0:1787574486.220703:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2402:x1874407323656832:12345-192.168.202.40@tcp:101:bash.0 Request processed in 154us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574486.220710:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00080000:1.0:1787574486.221119:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574486.224801:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.224965:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323656960 00000100:00100000:3.0:1787574486.224975:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323656960 00000100:00100000:3.0:1787574486.225032:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:3.0:1787574486.225043:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:11375:x1874407323656960:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1787574486.225060:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574486.225078:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b793 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.225123:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000724c862e/0xd18a1efeeddb8675 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b78c expref: 9 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.225132:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574486.225136:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574486.225141:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.225220:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000724c862e/0xd18a1efeeddb8675 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b78c expref: 9 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.225230:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000724c862e/0xd18a1efeeddb8675 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b78c expref: 9 pid: 8423 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574486.225258:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874407346812800:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574486.225330:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518b95f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574486.229896:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574486.231547:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323657088 00000100:00100000:1.0:1787574486.231560:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323657088 00010000:00010000:1.0:1787574486.231606:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000724c862e/0xd18a1efeeddb8675 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b78c expref: 10 pid: 8423 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574486.231660:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:1.0:1787574486.231671:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:2404:x1874407323657088:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574486.231686:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574486.231708:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000724c862e/0xd18a1efeeddb8675 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b78c expref: 10 pid: 8423 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574486.231722:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000724c862e/0xd18a1efeeddb8675 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b78c expref: 10 pid: 8423 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574486.231746:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574486.231751:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574486.231760:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574486.231784:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574486.231841:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574486.231856:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5186d1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6495:1874407346812928:192.168.202.40@tcp:105: 00000100:00100000:1.0:1787574486.231948:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344b600 going to sleep for 11 seconds 00010000:00010000:3.0:1787574486.232622:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000724c862e/0xd18a1efeeddb8675 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b78c expref: 10 pid: 8423 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574486.232640:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874407346812800:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574486.232673:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.232685:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031a00, rc 0) 00000100:00100000:3.0:1787574486.232732:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:11375:x1874407323656960:12345-192.168.202.40@tcp:101:bash.0 Request processed in 7690us (7941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574486.232740:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:0.0:1787574486.242599:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.242683:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323657344 00000100:00100000:3.0:1787574486.242692:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323657344 00000100:00100000:3.0:1787574486.242758:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1787574486.242769:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:11375:x1874407323657344:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:3.0:1787574486.243087:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:11375:x1874407323657344:12345-192.168.202.40@tcp:35:bash.0 Request processed in 318us (498us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787574486.243095:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:1.0:1787574486.243366:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5186d1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6495:1874407346812928:192.168.202.40@tcp:105: 00010000:00010000:1.0:1787574486.243390:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574486.244141:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323657088:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 12467us (14250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574486.244152:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:1.0:1787574486.257607:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574486.257630:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346813056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574486.257705:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574486.257869:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346813056 00000100:00100000:3.0:1787574486.257877:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346813056 00000100:00100000:3.0:1787574486.257934:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787574486.257945:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346813056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574486.257978:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787574486.258030:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346813056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574486.258038:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787574486.258129:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346813056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574486.405868:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.405972:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323657472 00000100:00100000:3.0:1787574486.405983:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323657472 00000100:00100000:3.0:1787574486.406052:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:3.0:1787574486.406064:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:11391:x1874407323657472:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574486.406088:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574486.406331:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8683 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b79a expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.406403:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb868a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.406418:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb868a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.406428:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb868a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574486.406488:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787574486.406492:0:11515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574486.406511:0:11515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb868a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.406536:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8683 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b79a expref: 40 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.406553:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb868a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b79a expref: 39 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.406562:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574486.406565:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574486.406568:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031600, rc 0) 00000100:00100000:3.0:1787574486.406753:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:11391:x1874407323657472:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 691us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574486.406761:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:1.0:1787574486.411127:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.411282:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323657728 00000100:00100000:2.0:1787574486.411292:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323657728 00000100:00100000:2.0:1787574486.411360:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 109 00000100:00100000:2.0:1787574486.411371:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5186d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:11391:x1874407323657728:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574486.411404:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574486.411426:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8691 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7a1 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.411527:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8698 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.411539:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.411550:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574486.411560:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787574486.412079:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8691 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7a1 expref: 42 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.412113:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8698 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7a1 expref: 41 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.412123:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573b00) 00010000:00010000:2.0:1787574486.412126:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574486.412130:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fabe00, rc 0) 00000100:00100000:2.0:1787574486.412211:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5186d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+41:11391:x1874407323657728:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 840us (1092us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1787574486.412219:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 109 00000100:00100000:2.0:1787574486.416525:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.416599:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323657984 00000100:00100000:3.0:1787574486.416609:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323657984 00000100:00100000:3.0:1787574486.416669:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 110 00000100:00100000:3.0:1787574486.416680:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+41:11391:x1874407323657984:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574486.416704:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574486.416722:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.416834:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb86ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.416865:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb86ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.416876:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb86ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574486.416892:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787574486.416991:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7a8 expref: 44 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.417008:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb86ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7a8 expref: 43 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.417016:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573b00) 00010000:00010000:3.0:1787574486.417020:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787574486.417023:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030800, rc 0) 00000100:00100000:3.0:1787574486.417087:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:11391:x1874407323657984:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 407us (568us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1787574486.417102:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 110 00000100:00100000:1.0:1787574486.422431:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574486.423788:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323658112 00000100:00100000:0.0:1787574486.423802:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323658112 00000100:00100000:0.0:1787574486.423894:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1787574486.423905:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:2404:x1874407323658112:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574486.423920:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574486.423945:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8698 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7a1 expref: 43 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.423966:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573b00) 00010000:00010000:0.0:1787574486.423971:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574486.424045:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+42:2404:x1874407323658112:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 141us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.424053:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:1.0:1787574486.430571:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.430678:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323658240 00000100:00100000:2.0:1787574486.430688:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323658240 00000100:00100000:2.0:1787574486.430758:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:2.0:1787574486.430768:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323658240:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:2.0:1787574486.430812:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.430842:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.430851:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574486.430855:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574486.430859:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.430894:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.430908:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 8 pid: 8426 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574486.430922:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1874407346813184:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574486.431022:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023f2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574486.436714:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1874407346813184:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574486.436746:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574486.440230:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.440548:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323658368 00000100:00100000:2.0:1787574486.440558:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323658368 00002000:00100000:2.0:1787574486.440610:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9ca4034ddc00 x1874407323658368/t0(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:257/0 lens 504/0 e 0 to 0 dl 1787574497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574486.440622:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca4034ddc00 with x1874407323658368 ext(0->8) 00010000:00010000:2.0:1787574486.440655:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 9 pid: 8426 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.440673:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 9 pid: 8426 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574486.440681:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ca4034ddc00 00000100:00100000:2.0:1787574486.440717:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:2.0:1787574486.440728:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2404:x1874407323658368:12345-192.168.202.40@tcp:4:lfs.0 00000100:00100000:2.0:1787574486.441518:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:2404:x1874407323658368:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 788us (1293us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787574486.441528:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00002000:00100000:2.0:1787574486.441536:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9ca4034ddc00 x1874407323658368/t4294967303(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:257/0 lens 504/448 e 0 to 0 dl 1787574497 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574486.441545:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca4034ddc00 with x1874407323658368 ext(0->8) 00010000:00010000:2.0:1787574486.441552:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 11 pid: 8426 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.441566:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 11 pid: 8426 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574486.441574:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ca4034ddc00 00000100:00100000:2.0:1787574486.445871:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574486.445976:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323658496 00000100:00100000:1.0:1787574486.445986:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323658496 00010000:00010000:1.0:1787574486.446026:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 11 pid: 8426 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574486.446106:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:1.0:1787574486.446117:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:2405:x1874407323658496:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574486.446132:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787574486.446152:0:6494:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787574486.446155:0:6494:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787574485 00002000:00010000:1.0:1787574486.446157:0:6494:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787574486 00002000:00010000:1.0:1787574486.446159:0:6494:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787574485 00002000:00010000:1.0:1787574486.446161:0:6494:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787574486.446167:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 11 pid: 8426 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574486.446191:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 11 pid: 8426 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574486.446214:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb867c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b793 expref: 11 pid: 8426 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574486.446231:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574486.446236:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574486.446289:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574486.446298:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574486.446344:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574486.446401:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:2405:x1874407323658496:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 285us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574486.446408:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00010000:00010000:2.0:1787574486.446595:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.446615:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.446635:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.446653:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.446663:0:8423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.446670:0:8423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574486.446674:0:8423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.446683:0:8423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.446697:0:8423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.446704:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb86bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574486.446775:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2405:x1874407323658240:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 16007us (16214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574486.446783:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:2.0:1787574486.452356:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.452486:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323658752 00000100:00100000:3.0:1787574486.452497:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323658752 00000100:00100000:3.0:1787574486.452563:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1787574486.452574:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b659c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+42:11391:x1874407323658752:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:3.0:1787574486.452643:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb86ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7a8 expref: 42 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787574486.453067:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1787574486.453356:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787574486.453733:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1787574486.453771:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.453788:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8667 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b785 expref: 46 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.453798:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.453904:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8667 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b785 expref: 46 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.453919:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8667 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b785 expref: 46 pid: 6510 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574486.453933:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6513:1874407346813312:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574486.454221:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca534b43000 going to sleep for 11 seconds 00000100:00100000:3.0:1787574486.458369:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6513:1874407346813312:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574486.458400:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574486.464571:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574486.464906:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323658880 00000100:00100000:0.0:1787574486.464919:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323658880 00010000:00010000:0.0:1787574486.464959:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8667 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b785 expref: 47 pid: 6510 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574486.465005:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:0.0:1787574486.465016:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+47:2404:x1874407323658880:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574486.465040:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574486.465048:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8667 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b785 expref: 47 pid: 6510 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.465062:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8667 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b785 expref: 47 pid: 6510 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.465084:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8667 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b785 expref: 47 pid: 6510 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.465112:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573b00) 00010000:00010000:0.0:1787574486.465117:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.465127:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.465135:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.465192:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574486.465299:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+46:2404:x1874407323658880:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 284us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.465307:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00010000:00010000:3.0:1787574486.465473:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.465481:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787574486.465592:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1787574486.465727:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1787574486.465818:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346813440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787574486.465868:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574486.465906:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5055d8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574486.466598:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346813440 00000100:00100000:0.0:1787574486.466605:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346813440 00000100:00100000:0.0:1787574486.466667:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787574486.466675:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6513:x1874407346813440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787574486.466760:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6513:x1874407346813440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 86us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.466767:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787574486.466893:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346813440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787574486.467043:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1787574486.467105:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346813568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787574486.467138:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574486.467160:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509d9f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787574486.467501:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346813568 00000100:00100000:0.0:1787574486.467505:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346813568 00000100:00100000:0.0:1787574486.467530:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787574486.467538:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6513:x1874407346813568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787574486.467643:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6513:x1874407346813568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (503us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787574486.467651:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787574486.467678:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346813568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787574486.467725:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00080000:2.0:1787574486.467736:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787574486.467757:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.467766:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.467773:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.467779:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574486.467783:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.467790:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.467805:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573b00) 00010000:00010000:3.0:1787574486.467807:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787574486.467821:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574486.467828:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb86c2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787574486.467911:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787574486.467967:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787574486.467978:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425650737396ns, next at 426650735018ns, rc = 0 00000001:00080000:3.0:1787574486.467984:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1787574486.468005:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573b00) 00010000:00010000:3.0:1787574486.468008:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787574486.468014:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb86ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7a8 expref: 50 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574486.468289:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b659c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+49:11391:x1874407323658752:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 15714us (15942us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787574486.468297:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000020:00080000:3.0:1787574486.468300:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787574486.472383:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.474291:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323659008 00000100:00100000:3.0:1787574486.474305:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323659008 00000100:00100000:2.0:1787574486.474431:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:2.0:1787574486.474442:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+49:11391:x1874407323659008:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574486.474467:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574486.474488:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb86c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7af expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.474534:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb86c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7af expref: 50 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.474544:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb86c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7af expref: 50 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.474557:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:2.0:1787574486.474559:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574486.474562:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faa600, rc 0) 00000100:00100000:2.0:1787574486.474617:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+50:11391:x1874407323659008:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 177us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574486.474624:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:0.0:1787574486.478481:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.478522:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323659264 00000100:00100000:3.0:1787574486.478532:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323659264 00000100:00100000:3.0:1787574486.478589:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1787574486.478600:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+50:11391:x1874407323659264:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1787574486.479220:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+51:11391:x1874407323659264:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 620us (745us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787574486.479228:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:1.0:1787574486.601051:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574486.601191:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323659392 00000100:00100000:0.0:1787574486.601201:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323659392 00000100:00100000:0.0:1787574486.601313:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:0.0:1787574486.601322:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+51:11401:x1874407323659392:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1787574486.601395:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601428:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601439:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601450:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601458:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601464:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601538:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601546:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601553:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574486.601596:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601609:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601616:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601633:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601639:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574486.601656:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601664:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601676:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:0.0:1787574486.601679:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574486.601683:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601689:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601703:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601709:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601715:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601720:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574486.601723:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601741:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601750:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca520573100) 00010000:00010000:0.0:1787574486.601753:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574486.601756:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601762:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601771:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601777:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601782:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601786:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574486.601789:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601794:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601800:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574486.601802:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574486.601804:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.601819:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574486.601886:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+51:11401:x1874407323659392:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 564us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.601894:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:2.0:1787574486.661565:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574486.661674:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323659648 00000100:00100000:0.0:1787574486.661685:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323659648 00000100:00100000:0.0:1787574486.661746:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:0.0:1787574486.661757:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+51:11404:x1874407323659648:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574486.661776:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574486.661796:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7b6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.661876:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.661891:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.661902:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.661911:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.661917:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.661940:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662054:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb86fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662062:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb86fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662069:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb86fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574486.662078:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787574486.662170:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662188:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662194:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662199:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574486.662203:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662210:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662221:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:0.0:1787574486.662224:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574486.662234:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662284:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb86ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662297:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662303:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662308:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662312:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574486.662315:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662321:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662328:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca520573100) 00010000:00010000:0.0:1787574486.662330:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574486.662333:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662337:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb86f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662380:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb86e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7b6 expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662404:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb86fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7b6 expref: 53 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574486.662412:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574486.662414:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574486.662416:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11200, rc 0) 00000100:00100000:0.0:1787574486.662466:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+53:11404:x1874407323659648:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 711us (912us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787574486.662473:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:1.0:1787574486.672106:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.672295:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323659776 00000100:00100000:2.0:1787574486.672306:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323659776 00000100:00100000:2.0:1787574486.672375:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:2.0:1787574486.672386:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+53:11404:x1874407323659776:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1787574486.672458:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8708 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.672477:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.672488:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.672524:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.672531:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8708 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.672537:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8708 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.672543:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574486.672547:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8708 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.672554:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8708 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.672565:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:2.0:1787574486.672568:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574486.672585:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8708 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.672591:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8708 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574486.672674:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+53:11404:x1874407323659776:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 289us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574486.672681:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:1.0:1787574486.679601:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574486.680343:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323660032 00000100:00100000:0.0:1787574486.680430:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323660032 00000100:00100000:0.0:1787574486.680530:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1787574486.680542:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+53:11404:x1874407323660032:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1787574486.680768:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+54:11404:x1874407323660032:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 227us (1176us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1787574486.680777:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00010000:00010000:1.0:1787574486.705408:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574486.769761:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca518b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346814080:0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.769833:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574486.769894:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346814592:0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.769917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574486.769937:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346815104:0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.769958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574486.769982:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787574486.769988:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346813952:0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.770016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574486.770035:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346814464:0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.770056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574486.770069:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346814976:0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.770105:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574486.770142:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346814080 00000100:00100000:1.0:1787574486.770150:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346814080 00000100:00100000:1.0:1787574486.770195:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346814592 00000100:00100000:1.0:1787574486.770212:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346814592 00000100:00100000:1.0:1787574486.770258:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346815104 00000100:00100000:1.0:1787574486.770261:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346815104 00000100:00100000:1.0:1787574486.770274:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346814464 00000100:00100000:1.0:1787574486.770276:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346814464 00000100:00100000:1.0:1787574486.770287:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346814976 00000100:00100000:1.0:1787574486.770289:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346814976 00000100:00100000:1.0:1787574486.770301:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787574486.770309:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346814080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.770357:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346814080:12345-0@lo:400:kworker.0 Request processed in 48us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574486.770364:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787574486.770380:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787574486.770385:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346814592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.770411:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346814592:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574486.770417:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787574486.770428:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787574486.770434:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40345e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346815104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.770459:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40345e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346815104:12345-0@lo:400:kworker.0 Request processed in 25us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574486.770465:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787574486.770475:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787574486.770481:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346814464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.770504:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346814464:12345-0@lo:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574486.770510:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787574486.770528:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1787574486.770535:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40351fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346814976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.770561:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40351fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346814976:12345-0@lo:400:kworker.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574486.770566:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00080000:1.0:1787574486.770581:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574486.770585:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574486.770608:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346814464:0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.770618:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346814976:0@lo:400:kworker.0 00000100:00100000:1.0:1787574486.770626:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca518b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346814080:0@lo:400:kworker.0 00010000:00080000:1.0:1787574486.770637:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4bc700 x1874407346814592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574486.770647:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346814592:0@lo:400:kworker.0 00010000:00080000:1.0:1787574486.770657:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4025fed80 x1874407346815104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574486.770665:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346815104:0@lo:400:kworker.0 00000100:00100000:3.0:1787574486.770904:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346813952 00000100:00100000:3.0:1787574486.770914:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346813952 00000100:00100000:3.0:1787574486.770956:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1787574486.770963:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346813952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574486.771005:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346813952:12345-0@lo:400:kworker.0 Request processed in 43us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574486.771011:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1787574486.771190:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346813952:0@lo:400:kworker.0 00000100:00100000:2.0:1787574486.771814:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346813696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574486.771858:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574486.771892:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca518b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346814208:0@lo:400:kworker.0 00000100:00100000:2.0:1787574486.771914:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574486.771940:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346814720:0@lo:400:kworker.0 00000100:00100000:2.0:1787574486.771964:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574486.771994:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4025fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346815232:0@lo:400:kworker.0 00000100:00100000:2.0:1787574486.772012:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574486.772042:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787574486.772049:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346813824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574486.772070:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574486.772085:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca518b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346814336:0@lo:400:kworker.0 00000100:00100000:0.0:1787574486.772194:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346814720 00000100:00100000:0.0:1787574486.772199:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346814720 00000100:00100000:0.0:1787574486.772237:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346815232 00000100:00100000:0.0:1787574486.772265:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346815232 00000100:00100000:0.0:1787574486.772292:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787574486.772300:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346814720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574486.772339:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346814720:12345-0@lo:400:kworker.0 Request processed in 40us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.772345:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787574486.772370:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787574486.772376:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346815232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574486.772404:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346815232:12345-0@lo:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.772410:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1787574486.772425:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574486.772429:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574486.772456:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346814208 00000100:00100000:0.0:1787574486.772460:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346814208 00000100:00100000:0.0:1787574486.772482:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787574486.772489:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346814208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574486.772518:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346814208:12345-0@lo:400:kworker.0 Request processed in 30us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.772524:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787574486.772612:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346813696 00000100:00100000:3.0:1787574486.772617:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346813696 00000100:00100000:3.0:1787574486.772655:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346813824 00000100:00100000:3.0:1787574486.772659:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346813824 00000100:00100000:3.0:1787574486.772674:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787574486.772680:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346813696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574486.772694:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574486.772726:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346813696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574486.772732:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787574486.772744:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787574486.772749:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3634:x1874407346813824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574486.772758:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574486.772780:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3634:x1874407346813824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574486.772785:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787574486.773226:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574486.773272:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346814848:0@lo:400:kworker.0 00000100:00100000:2.0:1787574486.773292:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574486.773303:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346815360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574486.773324:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574486.773378:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346813696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574486.773390:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca518b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346814208:0@lo:400:kworker.0 00000100:00100000:2.0:1787574486.773399:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346814720:0@lo:400:kworker.0 00000100:00100000:2.0:1787574486.773407:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4025fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346815232:0@lo:400:kworker.0 00000100:00100000:2.0:1787574486.773437:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346813824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574486.773458:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346814336 00000100:00100000:2.0:1787574486.773462:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346814336 00000100:00100000:2.0:1787574486.773488:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346815360 00000100:00100000:2.0:1787574486.773491:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346815360 00000100:00100000:2.0:1787574486.773503:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787574486.773510:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346814336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574486.773545:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346814336:12345-0@lo:400:kworker.0 Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574486.773550:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787574486.773562:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787574486.773568:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346815360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574486.773589:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787574486.773617:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346815360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574486.773622:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787574486.773654:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca518b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346814336:0@lo:400:kworker.0 00000100:00100000:2.0:1787574486.773664:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346815360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574486.773727:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346814848 00000100:00100000:0.0:1787574486.773731:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346814848 00000100:00100000:0.0:1787574486.773770:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787574486.773776:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346814848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574486.773808:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346814848:12345-0@lo:400:kworker.0 Request processed in 32us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.773814:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1787574486.773870:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574486.773889:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346814848:0@lo:400:kworker.0 00000100:00100000:3.0:1787574486.795516:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.795562:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.795596:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.795630:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.795657:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.795693:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.795720:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323660672 00000100:00100000:3.0:1787574486.795730:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323660672 00000100:00100000:3.0:1787574486.795778:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323660544 00000100:00100000:3.0:1787574486.795781:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323660544 00000100:00100000:3.0:1787574486.795834:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:3.0:1787574486.795844:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2405:x1874407323660672:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574486.795914:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2405:x1874407323660672:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574486.795922:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:3.0:1787574486.795938:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:3.0:1787574486.795945:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323660544:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574486.795969:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323660544:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574486.795975:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:3.0:1787574486.796018:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574486.796285:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323660416 00000100:00100000:0.0:1787574486.796289:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323660416 00000100:00100000:0.0:1787574486.796320:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323660928 00000100:00100000:0.0:1787574486.796322:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323660928 00000100:00100000:0.0:1787574486.796333:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323660288 00000100:00100000:0.0:1787574486.796335:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323660288 00000100:00100000:0.0:1787574486.796344:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323660800 00000100:00100000:0.0:1787574486.796346:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323660800 00000100:00100000:0.0:1787574486.796368:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 349 00000100:00100000:0.0:1787574486.796374:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323660416:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574486.796403:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323660416:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 30us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.796409:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 349 00000100:00100000:0.0:1787574486.796420:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 350 00000100:00100000:0.0:1787574486.796426:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323660928:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574486.796444:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323660928:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 19us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.796450:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 350 00000100:00100000:0.0:1787574486.796460:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 351 00000100:00100000:0.0:1787574486.796465:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+54:2405:x1874407323660288:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574486.796489:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+54:2405:x1874407323660288:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.796495:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 351 00000100:00100000:0.0:1787574486.796506:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 352 00000100:00100000:0.0:1787574486.796514:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323660800:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574486.796535:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323660800:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574486.796541:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 352 00000100:00100000:1.0:1787574486.797486:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323660160 00000100:00100000:1.0:1787574486.797495:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323660160 00000100:00100000:1.0:1787574486.797541:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 394 00000100:00100000:1.0:1787574486.797549:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323660160:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574486.797591:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323660160:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574486.797609:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 394 00000100:00080000:2.0:1787574486.799971:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574486.799979:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574486.814624:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.814732:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323661184 00000100:00100000:2.0:1787574486.814743:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323661184 00000100:00100000:2.0:1787574486.814803:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:2.0:1787574486.814814:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+54:11414:x1874407323661184:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574486.814834:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574486.814837:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787574486.815046:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb868a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b79a expref: 54 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.815066:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:2.0:1787574486.815072:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574486.815086:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb870f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7bd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.816005:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8716 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.816022:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.816220:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574486.816236:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787574486.816380:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb870f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7bd expref: 56 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.816848:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8716 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7bd expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.816868:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:2.0:1787574486.816871:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574486.816875:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab000, rc 0) 00000100:00100000:2.0:1787574486.816951:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+55:11414:x1874407323661184:12345-192.168.202.40@tcp:101:bash.0 Request processed in 2138us (2337us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787574486.816961:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:0.0:1787574486.821688:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.821761:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323661312 00000100:00100000:2.0:1787574486.821771:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323661312 00000100:00100000:2.0:1787574486.821836:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:2.0:1787574486.821846:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+55:11414:x1874407323661312:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574486.821869:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574486.821889:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8724 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.821920:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb872b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.821933:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb872b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.821945:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb872b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.822056:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8724 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7c4 expref: 57 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.822082:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb872b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7c4 expref: 56 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.822105:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:2.0:1787574486.822108:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787574486.822112:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab600, rc 0) 00000100:00100000:2.0:1787574486.822181:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+56:11414:x1874407323661312:12345-192.168.202.40@tcp:101:bash.0 Request processed in 327us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574486.822189:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:1.0:1787574486.827724:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.827813:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323661440 00000100:00100000:2.0:1787574486.827834:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323661440 00000100:00100000:2.0:1787574486.827907:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:2.0:1787574486.827918:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+56:2404:x1874407323661440:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574486.827934:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574486.827960:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8716 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7bd expref: 56 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.827982:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:2.0:1787574486.827987:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574486.828044:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+55:2404:x1874407323661440:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 128us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574486.828051:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1787574486.831909:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.831996:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323661696 00000100:00100000:2.0:1787574486.832006:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323661696 00000100:00100000:2.0:1787574486.832075:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:2.0:1787574486.832106:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+55:11414:x1874407323661696:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:2.0:1787574486.832156:0:8610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574486.832193:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb86fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7b6 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.832212:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:2.0:1787574486.832217:0:8610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574486.832411:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.832425:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.832434:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574486.832474:0:8610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1787574486.832495:0:8610:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a14d7e2 reply state 00000000f2fa5d86 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.832507:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.832512:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:2.0:1787574486.832515:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787574486.832517:0:8610:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574486.832594:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+57:11414:x1874407323661696:12345-192.168.202.40@tcp:36:bash.0 Request processed in 490us (695us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787574486.832601:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 117 00000020:00080000:2.0:1787574486.832606:0:8610:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787574486.838583:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574486.838655:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323661824 00000100:00100000:2.0:1787574486.838665:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323661824 00000100:00100000:2.0:1787574486.838727:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:2.0:1787574486.838739:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4025fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+57:11414:x1874407323661824:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574486.838758:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574486.838779:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8739 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7cb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.838877:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.838890:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.838902:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574486.838932:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787574486.838936:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574486.838953:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.838978:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8739 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7cb expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.838997:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7cb expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574486.839005:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:2.0:1787574486.839009:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574486.839026:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab200, rc 0) 00000100:00100000:2.0:1787574486.839106:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4025fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+58:11414:x1874407323661824:12345-192.168.202.40@tcp:101:bash.0 Request processed in 370us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574486.839112:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:1.0:1787574486.859555:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574486.859638:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323662080 00000100:00100000:3.0:1787574486.859648:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323662080 00000100:00100000:3.0:1787574486.859704:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:3.0:1787574486.859713:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+58:11414:x1874407323662080:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:3.0:1787574486.859965:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+59:11414:x1874407323662080:12345-192.168.202.40@tcp:35:bash.0 Request processed in 252us (420us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787574486.859974:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:1.0:1787574487.047682:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.047788:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323662208 00000100:00100000:0.0:1787574487.047798:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323662208 00000100:00100000:0.0:1787574487.047903:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:0.0:1787574487.047914:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+59:11420:x1874407323662208:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574487.047937:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574487.047956:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8747 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.048021:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb874e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.048035:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb874e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.048046:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb874e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574487.048096:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787574487.048100:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574487.048120:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb874e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.048143:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7d2 expref: 61 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.048159:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb874e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7d2 expref: 60 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.048166:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:0.0:1787574487.048180:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574487.048184:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11600, rc 0) 00000100:00100000:0.0:1787574487.048291:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:11420:x1874407323662208:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 379us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.048304:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00080000:2.0:1787574487.048515:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574487.061374:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.061485:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323662336 00000100:00100000:0.0:1787574487.061495:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323662336 00000100:00100000:0.0:1787574487.061554:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:0.0:1787574487.061565:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:11420:x1874407323662336:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574487.061583:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574487.061603:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8755 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7d9 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061668:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb875c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061683:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb875c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061695:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb875c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061707:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8763 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061728:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8763 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061735:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8763 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061810:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb876a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061847:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb876a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061854:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb876a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574487.061895:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787574487.061900:0:11515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574487.061918:0:11515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb876a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061929:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb876a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061937:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb875c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061944:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb875c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061950:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb875c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061956:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.061960:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb875c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061967:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb875c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061978:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:0.0:1787574487.061986:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.061991:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb875c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.061997:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb875c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.062010:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8763 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.062015:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8763 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.062019:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8763 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.062024:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.062027:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8763 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.062032:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8763 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.062038:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca520573100) 00010000:00010000:0.0:1787574487.062041:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.062043:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8763 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.062048:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8763 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.062071:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8755 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7d9 expref: 62 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.062097:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb876a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7d9 expref: 61 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.062104:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574487.062106:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574487.062108:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11200, rc 0) 00000100:00100000:0.0:1787574487.065670:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+61:11420:x1874407323662336:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 4093us (4292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.065683:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:3.0:1787574487.095726:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.096203:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323662464 00000100:00100000:0.0:1787574487.096213:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323662464 00000100:00100000:0.0:1787574487.096300:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:0.0:1787574487.096310:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+61:2405:x1874407323662464:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574487.096324:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574487.096343:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb876a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7d9 expref: 61 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.096361:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574487.096365:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574487.100266:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:2405:x1874407323662464:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 3931us (4524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.100282:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:2.0:1787574487.112182:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.118470:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323662720 00000100:00100000:3.0:1787574487.118486:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323662720 00000100:00100000:3.0:1787574487.118593:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:3.0:1787574487.118601:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:11420:x1874407323662720:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574487.118619:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574487.118635:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8771 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.118737:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.118752:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7cb expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.118762:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.118795:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7cb expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.118805:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7cb expref: 61 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574487.118815:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346815488:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574487.118881:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca534b43000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574487.147235:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.148469:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346815488:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574487.148494:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574487.148643:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323662848 00000100:00100000:2.0:1787574487.148651:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323662848 00010000:00010000:2.0:1787574487.148691:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7cb expref: 62 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574487.148741:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:2.0:1787574487.148750:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+62:2405:x1874407323662848:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574487.148768:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574487.148774:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7cb expref: 62 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.148786:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7cb expref: 62 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.148808:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8740 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7cb expref: 62 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.148836:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:2.0:1787574487.148841:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.148850:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.148869:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.148898:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574487.149006:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+61:2405:x1874407323662848:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 256us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574487.149015:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00010000:00010000:3.0:1787574487.149139:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.149152:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574487.149178:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787574487.149325:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8771 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e0 expref: 62 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.149341:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e0 expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.149349:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:3.0:1787574487.149352:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574487.149355:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030800, rc 0) 00000100:00100000:3.0:1787574487.149376:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+61:11420:x1874407323662720:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 30777us (37213us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787574487.149383:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:1.0:1787574487.162504:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.162589:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323663104 00000100:00100000:3.0:1787574487.162599:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323663104 00000100:00100000:3.0:1787574487.162659:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1787574487.162670:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+61:11420:x1874407323663104:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:3.0:1787574487.162696:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574487.162721:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb86c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7af expref: 61 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.162743:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:3.0:1787574487.162748:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574487.162816:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:11420:x1874407323663104:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 148us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574487.162824:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:1.0:1787574487.168288:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574487.168384:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323663232 00000100:00100000:2.0:1787574487.168395:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323663232 00000100:00100000:2.0:1787574487.168448:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:2.0:1787574487.168459:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:11420:x1874407323663232:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:2.0:1787574487.168560:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.168577:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.168588:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787574487.168675:0:8610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787574487.168759:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:11420:x1874407323663232:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 302us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574487.168766:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:1.0:1787574487.174146:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.174281:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323663360 00000100:00100000:0.0:1787574487.174291:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323663360 00000100:00100000:0.0:1787574487.174347:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:0.0:1787574487.174372:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:11420:x1874407323663360:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574487.174393:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574487.174414:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb878d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7e7 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.174469:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.174481:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb878d lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e7 expref: 61 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.174501:0:11515:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.174515:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb878d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e7 expref: 61 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.174531:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574487.174534:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574487.174538:0:11515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb878d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e7 expref: 61 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.174546:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11200, rc 0) 00000100:00100000:0.0:1787574487.174609:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+61:11420:x1874407323663360:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 240us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.174617:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 123 00000040:00080000:0.0:1787574487.409467:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574487.409480:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574487.409519:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787574487.409530:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787574487.409667:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f524380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346815616:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787574487.409778:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574487.413204:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f524380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346815616:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787574487.418697:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.418943:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323663488 00000100:00100000:3.0:1787574487.418954:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323663488 00000100:00100000:3.0:1787574487.419025:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:3.0:1787574487.419035:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+61:11421:x1874407323663488:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787574487.419068:0:6510:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787574487.419233:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+61:11421:x1874407323663488:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 199us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574487.419277:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:1.0:1787574487.430057:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.430310:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323663616 00000100:00100000:0.0:1787574487.430321:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323663616 00000100:00100000:0.0:1787574487.430402:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:0.0:1787574487.430413:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+61:11421:x1874407323663616:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787574487.430486:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8794 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430503:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430514:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430529:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb879b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430536:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb879b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430543:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb879b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430565:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430593:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430600:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574487.430647:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787574487.430651:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574487.430663:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430674:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430680:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8794 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430686:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8794 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430692:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.430696:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8794 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430702:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8794 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430727:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:0.0:1787574487.430730:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.430735:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8794 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430752:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8794 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430764:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb879b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430770:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb879b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430775:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb879b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430780:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.430783:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb879b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430789:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb879b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430797:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9ca534a4c500) 00010000:00010000:0.0:1787574487.430799:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.430801:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb879b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430806:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb879b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430818:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430824:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430836:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430841:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.430844:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430849:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430857:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574487.430859:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.430862:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.430868:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.430949:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+61:11421:x1874407323663616:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 537us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.430956:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:0.0:1787574487.438158:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574487.438302:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323663872 00000100:00100000:1.0:1787574487.438311:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323663872 00000100:00100000:1.0:1787574487.438370:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:1.0:1787574487.438380:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+61:11421:x1874407323663872:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574487.438416:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574487.438442:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb87a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438543:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb87b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438558:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb87b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438569:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb87b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574487.438596:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787574487.438688:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb87b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438696:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb87b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438703:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb87b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438709:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574487.438715:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb87b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438723:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb87b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438734:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:1.0:1787574487.438737:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787574487.438741:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb87b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438747:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb87b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438789:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb87a9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7ee expref: 63 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438799:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:1.0:1787574487.438802:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574487.438824:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb87a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7ee expref: 63 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.438834:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19200, rc 0) 00000100:00100000:1.0:1787574487.438903:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+62:11421:x1874407323663872:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 524us (754us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1787574487.438911:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:1.0:1787574487.449638:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574487.450186:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323664000 00000100:00100000:2.0:1787574487.450197:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323664000 00000100:00100000:2.0:1787574487.450295:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:2.0:1787574487.450307:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+62:11421:x1874407323664000:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787574487.450359:0:8610:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787574487.450481:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+62:11421:x1874407323664000:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 176us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574487.450489:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:2.0:1787574487.455951:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.456511:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323664256 00000100:00100000:0.0:1787574487.456521:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323664256 00000100:00100000:0.0:1787574487.456583:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:0.0:1787574487.456594:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+62:11421:x1874407323664256:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574487.456615:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574487.456618:0:11515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787574487.456645:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb874e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7d2 expref: 62 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.456673:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:0.0:1787574487.456678:0:11515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574487.456692:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87be lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7f5 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787574487.457799:0:11515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787574487.457971:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb87c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.457986:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb87c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.457995:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb87c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.458053:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb87be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7f5 expref: 64 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.458070:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb87c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7f5 expref: 63 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.458077:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c500) 00010000:00010000:0.0:1787574487.458092:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574487.458095:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10800, rc 0) 00000100:00100000:0.0:1787574487.458161:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+63:11421:x1874407323664256:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1568us (2220us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787574487.458179:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:3.0:1787574487.466328:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.466629:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323664512 00000100:00100000:0.0:1787574487.466640:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323664512 00000100:00100000:0.0:1787574487.466694:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:0.0:1787574487.466705:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+63:11421:x1874407323664512:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574487.466765:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574487.466794:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb87c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7f5 expref: 63 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466823:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c500) 00010000:00010000:0.0:1787574487.466833:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574487.466853:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466867:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466877:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466890:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb7c6c6d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466897:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb7c6c6d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466903:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb7c6c6d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466945:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466966:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466973:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466979:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.466983:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466990:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.466999:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:0.0:1787574487.467001:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.467005:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.467011:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.467021:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb7c6c6d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.467026:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb7c6c6d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.467032:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb7c6c6d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.467037:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.467046:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb7c6c6d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.467054:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb7c6c6d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.467062:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb7c6c6d9 (ffff9ca534a4c400) 00010000:00010000:0.0:1787574487.467064:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.467067:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87da lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb7c6c6d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.467072:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb7c6c6d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.467162:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+62:11421:x1874407323664512:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 458us (843us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787574487.467179:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:3.0:1787574487.488772:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.488893:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323664640 00000100:00100000:0.0:1787574487.488904:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323664640 00000100:00100000:0.0:1787574487.488971:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:0.0:1787574487.488983:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+62:11421:x1874407323664640:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574487.489007:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574487.489031:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b7fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.489069:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.489083:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.489121:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.489290:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7fc expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.489308:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7fc expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.489317:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:0.0:1787574487.489320:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574487.489324:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11a00, rc 0) 00000100:00100000:0.0:1787574487.489382:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+63:11421:x1874407323664640:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 400us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.489401:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:1.0:1787574487.503175:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.504011:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323664896 00000100:00100000:0.0:1787574487.504023:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323664896 00000100:00100000:0.0:1787574487.504096:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:0.0:1787574487.504108:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+63:11421:x1874407323664896:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574487.504208:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.504225:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.504236:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574487.504622:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787574487.504632:0:6509:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426687391349ns, next at 427687388700ns, rc = 0 00000004:00010000:0.0:1787574487.504678:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dd20d35 reply state 00000000ea4ee53a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.504692:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.504699:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:0.0:1787574487.504703:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787574487.504778:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574487.505608:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+65:11421:x1874407323664896:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 1497us (2446us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787574487.505617:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:1.0:1787574487.514834:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.514972:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323665024 00000100:00100000:3.0:1787574487.514982:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323665024 00000100:00100000:3.0:1787574487.515042:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:3.0:1787574487.515053:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+65:11421:x1874407323665024:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574487.515078:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574487.515109:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb87f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b803 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.515177:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb87f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b803 expref: 66 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.515193:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb87f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b803 expref: 66 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.515235:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:3.0:1787574487.515274:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574487.515278:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031e00, rc 0) 00000100:00100000:3.0:1787574487.515332:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:11421:x1874407323665024:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 281us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574487.515339:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:1.0:1787574487.519784:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.519980:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323665152 00000100:00100000:3.0:1787574487.519991:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323665152 00000100:00100000:3.0:1787574487.520070:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1787574487.520092:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323665152:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787574487.520345:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2405:x1874407323665152:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 264us (570us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787574487.520352:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00080000:2.0:1787574487.520523:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574487.532001:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.532095:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323665408 00000100:00100000:3.0:1787574487.532107:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323665408 00000100:00100000:3.0:1787574487.532174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:3.0:1787574487.532185:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:11421:x1874407323665408:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787574487.532856:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+67:11421:x1874407323665408:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 669us (862us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1787574487.532865:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:1.0:1787574487.537987:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574487.538386:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323665664 00000100:00100000:2.0:1787574487.538397:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323665664 00000100:00100000:2.0:1787574487.538462:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:2.0:1787574487.538473:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+67:11421:x1874407323665664:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787574487.538597:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+67:11421:x1874407323665664:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 125us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574487.538605:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:1.0:1787574487.541390:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.541476:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323665792 00000100:00100000:3.0:1787574487.541486:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323665792 00000100:00100000:3.0:1787574487.541547:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:3.0:1787574487.541558:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4019ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+67:11421:x1874407323665792:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574487.541577:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574487.541598:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb87fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b80a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.541684:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8804 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.541698:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.541721:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574487.541764:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574487.541781:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.541818:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb87fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b80a expref: 69 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.541836:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8804 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b80a expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.541845:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:3.0:1787574487.541848:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787574487.541851:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031600, rc 0) 00000100:00100000:3.0:1787574487.541911:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4019ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+68:11421:x1874407323665792:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 355us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574487.541919:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:1.0:1787574487.545851:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.545986:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323665920 00000100:00100000:3.0:1787574487.545995:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323665920 00000100:00100000:3.0:1787574487.546050:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:3.0:1787574487.546069:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2404:x1874407323665920:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574487.546098:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574487.546118:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb880b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b811 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787574487.546143:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c38d7, blocks: 0x0 00010000:00010000:3.0:1787574487.546163:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1787574487.546177:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574487.546187:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb880b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b811 expref: 10 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.546205:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb880b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b811 expref: 10 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.546220:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031a00, rc 0) 00000100:00100000:0.0:1787574487.547221:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:2404:x1874407323665920:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1149us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.547230:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:1.0:1787574487.555624:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.555712:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323666176 00000100:00100000:0.0:1787574487.555722:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323666176 00000100:00100000:0.0:1787574487.555782:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:0.0:1787574487.555792:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+68:11421:x1874407323666176:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787574487.555912:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+68:11421:x1874407323666176:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 121us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.555920:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:1.0:1787574487.570095:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.570188:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323666304 00000100:00100000:3.0:1787574487.570198:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323666304 00000100:00100000:3.0:1787574487.570286:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:3.0:1787574487.570297:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:11421:x1874407323666304:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574487.570315:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574487.570332:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b818 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.570365:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb880b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b811 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.570395:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574487.570399:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574487.570405:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 11 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.570444:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb880b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b811 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.570457:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb880b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b811 expref: 11 pid: 8423 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574487.570473:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1874407346815744:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574487.570574:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574487.573139:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1874407346815744:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574487.573200:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 11 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.573221:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030c00, rc 0) 00000100:00100000:3.0:1787574487.573311:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:11421:x1874407323666304:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 3015us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574487.573320:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:1.0:1787574487.575780:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574487.575890:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323666432 00000100:00100000:2.0:1787574487.575900:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323666432 00010000:00010000:2.0:1787574487.575938:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb880b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b811 expref: 11 pid: 8423 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574487.575982:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:2.0:1787574487.575993:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:2405:x1874407323666432:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574487.576007:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574487.576029:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb880b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b811 expref: 11 pid: 8423 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.576060:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb880b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b811 expref: 11 pid: 8423 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.576092:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb880b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b811 expref: 11 pid: 8423 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.576111:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574487.576116:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574487.576124:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.576135:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.576181:0:6494:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574487.576195:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f538380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6494:1874407346815872:192.168.202.40@tcp:105: 00000100:00100000:2.0:1787574487.576315:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023f2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574487.580118:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f538380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6494:1874407346815872:192.168.202.40@tcp:105: 00010000:00010000:2.0:1787574487.580145:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574487.580209:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:2405:x1874407323666432:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 4217us (4436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574487.580221:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:1.0:1787574487.587608:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574487.587719:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323666560 00000100:00100000:2.0:1787574487.587728:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323666560 00002000:00100000:2.0:1787574487.587778:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9ca404131880 x1874407323666560/t0(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:258/0 lens 504/0 e 0 to 0 dl 1787574498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574487.587789:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404131880 with x1874407323666560 ext(0->12) 00002000:00010000:2.0:1787574487.587795:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca404131880 00000100:00100000:2.0:1787574487.587838:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:2.0:1787574487.587849:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:2405:x1874407323666560:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787574487.589437:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404131880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:2405:x1874407323666560:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 1583us (1831us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787574487.589449:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00002000:00100000:2.0:1787574487.589459:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9ca404131880 x1874407323666560/t4294967309(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:258/0 lens 504/448 e 0 to 0 dl 1787574498 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574487.589469:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404131880 with x1874407323666560 ext(0->12) 00002000:00010000:2.0:1787574487.589474:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca404131880 00000100:00100000:1.0:1787574487.594200:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.600291:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323666688 00000100:00100000:0.0:1787574487.600307:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323666688 00000100:00100000:0.0:1787574487.600410:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:0.0:1787574487.600422:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+68:11421:x1874407323666688:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787574487.603656:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1787574487.603674:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1787574487.603718:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787574487.603736:0:6488:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ca51017ea80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787574487.603740:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca506508700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ca51017e780 00000020:00080000:1.0:1787574487.603744:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca506508d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ca5030c4600 00000020:00080000:1.0:1787574487.603789:0:6488:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ca51017e900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787574487.603801:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca506508500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ca51017ecc0 00000020:00080000:1.0:1787574487.603804:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca506508600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ca521959600 00000100:00100000:1.0:1787574487.603917:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574487.603934:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346816000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787574487.603998:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787574487.604263:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1787574487.604335:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787574487.604349:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574487.604359:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346816128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787574487.604396:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574487.604425:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346816256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787574487.604447:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574487.604491:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346816000 00000100:00100000:3.0:1787574487.604498:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346816000 00000100:00100000:3.0:1787574487.604539:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346816128 00000100:00100000:3.0:1787574487.604542:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346816128 00000100:00100000:3.0:1787574487.604554:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346816256 00000100:00100000:3.0:1787574487.604557:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346816256 00000100:00100000:3.0:1787574487.604571:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787574487.604579:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3637:x1874407346816000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787574487.604604:0:8619:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1787574487.604638:0:8619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c38d5, atime: 0x6a8c38d6, ctime: 0x6a8c38d5, blocks: 0x8 00010000:00010000:3.0:1787574487.604647:0:8619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb8819 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.604665:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1787574487.604671:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574487.604678:0:8619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb8819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.604694:0:8619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb8819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.604704:0:8619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb8819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.604724:0:8619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb8819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.604739:0:8619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787574487.604873:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3637:x1874407346816000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 294us (874us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787574487.604881:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787574487.604898:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787574487.604905:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3636:x1874407346816128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787574487.604919:0:8619:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1787574487.604934:0:8619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.604950:0:8619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000987c9c01/0xd18a1efeeddb85cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b770 expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.604958:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787574487.604961:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574487.604966:0:8619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.604993:0:8619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000987c9c01/0xd18a1efeeddb85cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b770 expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.605007:0:8619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000987c9c01/0xd18a1efeeddb85cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b770 expref: 11 pid: 8425 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574487.605026:0:8619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8619:1874407346816384:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574487.605087:0:8619:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509d9f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574487.605106:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787574487.605114:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3634:x1874407346816256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787574487.605201:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787574487.605204:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787574487 00002000:00010000:3.0:1787574487.605206:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787574487.605208:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787574487 -> 1787574487 00002000:00010000:3.0:1787574487.605210:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787574487.605266:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3634:x1874407346816256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (793us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787574487.605272:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1787574487.605306:0:3634:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca53f4b5180/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787574487.605312:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346816256:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1787574487.606420:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca404133480/2, rc 0, transno 4294967305 00000100:00100000:1.0:1787574487.606430:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346816000:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787574487.606522:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606534:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606541:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606547:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.606551:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606558:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606572:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ca50a599500) 00010000:00010000:0.0:1787574487.606575:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.606579:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606586:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8517 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606607:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606612:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606633:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606639:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.606642:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606649:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606657:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574487.606659:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.606662:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606668:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82000/0xd18a1efeeddb85bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606683:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606689:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606694:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606698:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.606701:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606718:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606726:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca520573100) 00010000:00010000:0.0:1787574487.606729:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.606732:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606738:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb863d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606751:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606756:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606761:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606766:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faba00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.606769:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606773:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606780:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca520573100) 00010000:00010000:0.0:1787574487.606782:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.606784:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606796:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8660 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606826:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606831:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606837:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606841:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.606844:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606849:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606856:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574487.606859:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.606861:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606866:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8732 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606876:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606881:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606893:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606897:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.606900:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606907:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606914:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:0.0:1787574487.606916:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787574487.606918:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606924:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb87ef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606946:0:13731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574487.606952:0:13731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb8819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606960:0:13731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574487.606963:0:13731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb8819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606970:0:13731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb8819 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606992:0:13731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb8819 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.606999:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb8819 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.607016:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574487.607018:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574487.607020:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574487.607383:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:11421:x1874407323666688:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 6960us (13190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.607393:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:1.0:1787574487.611555:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.611783:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323666816 00000100:00100000:3.0:1787574487.611793:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323666816 00000100:00100000:3.0:1787574487.614001:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:3.0:1787574487.614018:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:2404:x1874407323666816:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787574487.614311:0:8619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8619:1874407346816384:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574487.614340:0:8619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574487.614509:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574487.615405:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323666944 00000100:00100000:2.0:1787574487.615414:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323666944 00010000:00010000:2.0:1787574487.615446:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000987c9c01/0xd18a1efeeddb85cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b770 expref: 13 pid: 8425 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574487.615482:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:2.0:1787574487.615499:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b689850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:2404:x1874407323666944:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574487.615513:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574487.615520:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000987c9c01/0xd18a1efeeddb85cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b770 expref: 13 pid: 8425 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.615534:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000987c9c01/0xd18a1efeeddb85cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b770 expref: 13 pid: 8425 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.615556:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000987c9c01/0xd18a1efeeddb85cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b770 expref: 13 pid: 8425 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.615572:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574487.615576:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574487.615582:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.615592:0:7451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.615616:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574487.615668:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b689850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:2404:x1874407323666944:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 170us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574487.615675:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00010000:00010000:2.0:1787574487.615728:0:8619:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.615748:0:8619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.615758:0:8619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.615766:0:8619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.615778:0:8619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574487.616186:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574487.616194:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.616202:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574487.616213:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.616223:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.616262:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.616271:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b700e73a/0xd18a1efeeddb8820 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.616289:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574487.616290:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574487.616292:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574487.618960:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3636:x1874407346816128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14048us (14556us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787574487.618973:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000001:00080000:0.0:1787574487.619489:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1787574487.619501:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000004:00080000:3.0:1787574487.619946:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca53f4b5c00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1787574487.619954:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346816128:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787574487.621132:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1787574487.621142:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1787574487.621337:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323666816:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 7319us (9787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.621347:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1787574487.626983:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574487.627106:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323667200 00000100:00100000:2.0:1787574487.627116:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323667200 00000100:00100000:2.0:1787574487.627190:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:2.0:1787574487.627201:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:11421:x1874407323667200:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787574487.627295:0:8610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574487.627322:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8804 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b80a expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.627342:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:2.0:1787574487.627347:0:8610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574487.627377:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.627631:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.627641:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574487.632316:0:8610:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000552b45f0 reply state 000000001b6b1b5d transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.632344:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.632354:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:1.0:1787574487.632357:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787574487.632361:0:8610:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787574487.632495:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:11421:x1874407323667200:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 5292us (5518us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1787574487.632503:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:1.0:1787574487.636273:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.636362:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323667328 00000100:00100000:0.0:1787574487.636373:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323667328 00000100:00100000:0.0:1787574487.636434:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:0.0:1787574487.636445:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323667328:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787574487.636601:0:8423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787574487.636606:0:8423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787574487 -> 1787574486 00002000:00010000:0.0:1787574487.636608:0:8423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787574486 00002000:00010000:0.0:1787574487.636610:0:8423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787574487 -> 1787574486 00002000:00010000:0.0:1787574487.636627:0:8423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787574487.636690:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323667328:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 246us (453us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787574487.636698:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:2.0:1787574487.640070:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.640372:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323667584 00000100:00100000:0.0:1787574487.640382:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323667584 00000100:00100000:0.0:1787574487.640452:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:0.0:1787574487.640462:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:11421:x1874407323667584:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787574487.640534:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.640552:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7fc expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.640561:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.640598:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7fc expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.640612:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7fc expref: 17 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.640626:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346816512:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574487.640713:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5420c7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574487.645847:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346816512:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574487.645882:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574487.648613:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.648707:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323667712 00000100:00100000:0.0:1787574487.648717:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323667712 00010000:00010000:0.0:1787574487.648760:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7fc expref: 18 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.648804:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:0.0:1787574487.648823:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f538700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:2405:x1874407323667712:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574487.648838:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574487.648846:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7fc expref: 18 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.648859:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7fc expref: 18 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.648884:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb87e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7fc expref: 18 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.648899:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:0.0:1787574487.648904:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.648913:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.648920:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.648955:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574487.649022:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f538700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:2405:x1874407323667712:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 200us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.649030:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00010000:00010000:1.0:1787574487.649546:0:11515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.649556:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.649603:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.649609:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.649615:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.649620:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574487.649623:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.649630:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.649641:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:1.0:1787574487.649644:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787574487.649647:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.649652:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb882e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574487.649708:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:11421:x1874407323667584:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 9247us (9647us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787574487.649717:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:2.0:1787574487.655016:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.655846:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323667840 00000100:00100000:0.0:1787574487.655859:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323667840 00000100:00100000:0.0:1787574487.655926:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:0.0:1787574487.655937:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323667840:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787574487.655979:0:8619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.656000:0:8619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.656009:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574487.656013:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787574487.656018:0:8619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.656071:0:8619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.656098:0:8619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 7 pid: 8426 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.656114:0:8619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8619:1874407346816640:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574487.656216:0:8619:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5420c7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574487.660308:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574487.660417:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323667968 00000100:00100000:2.0:1787574487.660428:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323667968 00010000:00010000:2.0:1787574487.660465:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 8 pid: 8426 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574487.660500:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:2.0:1787574487.660509:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323667968:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574487.660522:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574487.660543:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 8 pid: 8426 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.660557:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 8 pid: 8426 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.660583:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574487.660587:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574487.660594:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.660622:0:7451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.660644:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574487.660719:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323667968:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 209us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574487.660727:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 74 00010000:00010000:0.0:1787574487.661302:0:8619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb8812 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b818 expref: 7 pid: 8426 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.661319:0:8619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8619:1874407346816640:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574487.661342:0:8619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.661353:0:8619:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.661361:0:8619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.661384:0:8619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.661409:0:8619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.661417:0:8619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.661424:0:8619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574487.661428:0:8619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.661452:0:8619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.661466:0:8619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.661474:0:8619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0b8f068/0xd18a1efeeddb8835 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.661541:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323667840:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 5606us (6535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.661549:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:3.0:1787574487.664739:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.664832:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323668224 00000100:00100000:0.0:1787574487.664844:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323668224 00000100:00100000:0.0:1787574487.664907:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:0.0:1787574487.664917:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:11421:x1874407323668224:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787574487.664998:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.665016:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb872b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7c4 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.665026:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.665069:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb872b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7c4 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.665112:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb872b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7c4 expref: 16 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.665127:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346816768:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574487.665219:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5420c7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574487.668485:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574487.668622:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323668352 00000100:00100000:2.0:1787574487.668632:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323668352 00010000:00010000:2.0:1787574487.668672:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb872b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7c4 expref: 17 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574487.668716:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:2.0:1787574487.668725:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:2405:x1874407323668352:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574487.668740:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574487.668747:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb872b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7c4 expref: 17 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.668759:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb872b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7c4 expref: 17 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.668780:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:2.0:1787574487.668786:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb878d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e7 expref: 17 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.668824:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.668831:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.668838:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.668857:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574487.668914:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:2405:x1874407323668352:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 189us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574487.668921:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00010000:00010000:0.0:1787574487.674507:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb872b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7c4 expref: 16 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.674537:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346816768:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574487.674562:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.674573:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.674578:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.674755:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.674768:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb87f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b803 expref: 16 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.674777:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.674935:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb87f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b803 expref: 16 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.674963:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb87f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b803 expref: 16 pid: 8610 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.674978:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346816896:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574487.675512:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574487.692515:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574487.692617:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323668480 00000100:00100000:2.0:1787574487.692627:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323668480 00010000:00010000:2.0:1787574487.692673:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb87f6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b803 expref: 17 pid: 8610 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574487.692721:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:2.0:1787574487.692731:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:2405:x1874407323668480:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574487.692750:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574487.692757:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb87f6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b803 expref: 17 pid: 8610 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.692770:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb87f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b803 expref: 17 pid: 8610 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.692820:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:2.0:1787574487.692826:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.692837:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.692844:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574487.692863:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574487.692920:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:2405:x1874407323668480:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 190us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574487.692928:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00010000:00010000:0.0:1787574487.693104:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb87f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b803 expref: 16 pid: 8610 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.693122:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346816896:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574487.693144:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.693154:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.693159:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574487.693327:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1787574487.693444:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1787574487.693481:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1787574487.693567:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6509:1874407346817024:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787574487.693628:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574487.693656:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787574487.693855:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346817024 00000100:00100000:2.0:1787574487.693860:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346817024 00000100:00100000:2.0:1787574487.693902:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787574487.693910:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6509:x1874407346817024:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787574487.693995:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6509:x1874407346817024:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574487.694003:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787574487.694970:0:6509:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787574487.694979:0:6509:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1787574487.694998:0:6509:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca53f4b5180, transno 4294967310 00000100:00100000:0.0:1787574487.695028:0:6509:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ca53f4b5c00 x1874407346816128/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787574503 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574487.695049:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f526a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6509:1874407346817024:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787574487.695195:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1787574487.695283:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6509:1874407346817152:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787574487.695327:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574487.695350:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574487.695694:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346817152 00000100:00100000:1.0:1787574487.695708:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346817152 00000100:00100000:1.0:1787574487.695754:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787574487.695762:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6509:x1874407346817152:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787574487.695900:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6509:x1874407346817152:12345-0@lo:1000:mdt00_000.0 Request processed in 139us (572us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787574487.695908:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787574487.696185:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6509:1874407346817152:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787574487.696226:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696271:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696279:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696285:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.696290:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696298:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696315:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:0.0:1787574487.696318:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574487.696322:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696328:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8843 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696361:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696367:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696372:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696377:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.696380:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696385:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696407:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574487.696410:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574487.696416:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb878d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e7 expref: 19 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696428:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb878d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e7 expref: 19 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696436:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb878d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e7 expref: 19 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.696462:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb878d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e7 expref: 19 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.696487:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346817280:192.168.202.40@tcp:105: 00000100:00100000:1.0:1787574487.696825:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574487.703101:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346817280:192.168.202.40@tcp:105: 00010000:00010000:0.0:1787574487.703134:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703144:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8786 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703189:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb884a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703203:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb884a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703214:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb884a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703224:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb884a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703230:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb884a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703266:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb884a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703274:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.703278:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb884a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703304:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb884a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703317:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574487.703320:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574487.703324:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb884a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703330:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb884a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703340:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703345:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703351:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703356:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574487.703359:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703364:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703372:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574487.703374:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574487.703377:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.703801:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb883c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574487.704040:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:11421:x1874407323668224:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 39113us (39301us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787574487.704053:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 139 00000020:00080000:1.0:1787574487.704059:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787574487.704379:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574487.704383:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574487.704858:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787574487.704867:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787574487.707646:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.707729:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323668608 00000100:00100000:0.0:1787574487.707739:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323668608 00000100:00100000:0.0:1787574487.707795:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:0.0:1787574487.707806:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:11420:x1874407323668608:12345-192.168.202.40@tcp:49:lfs.0 00000100:00100000:0.0:1787574487.707949:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:11420:x1874407323668608:12345-192.168.202.40@tcp:49:lfs.0 Request processed in 144us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.707956:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1787574487.712375:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574487.712412:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.712518:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323668864 00000100:00100000:0.0:1787574487.712528:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323668864 00000100:00100000:0.0:1787574487.712578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:0.0:1787574487.712588:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b65a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:11421:x1874407323668864:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787574487.712854:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787574487.712888:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1787574487.712925:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8851 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.712942:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8851 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.712951:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8851 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.712973:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8851 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.712979:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8851 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.712984:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8851 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.713008:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787574487.713098:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b65a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:11421:x1874407323668864:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 510us (732us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787574487.713106:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000020:00080000:0.0:1787574487.713111:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787574487.713531:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323669120 00000100:00100000:1.0:1787574487.713537:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323669120 00000100:00100000:1.0:1787574487.713574:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:1.0:1787574487.713582:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:11420:x1874407323669120:12345-192.168.202.40@tcp:58:lfs.0 00000040:00080000:1.0:1787574487.713698:0:8610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787574487.713750:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:11420:x1874407323669120:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 168us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574487.713757:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 140 00010000:00010000:3.0:1787574487.713936:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574487.713944:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8851 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.713952:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574487.713964:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8851 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.713972:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8851 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.713987:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:3.0:1787574487.713990:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787574487.713994:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8851 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.714000:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb8851 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574487.714014:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574487.714016:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574487.714018:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574487.729451:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574487.746821:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574487.746935:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323669248 00000100:00100000:1.0:1787574487.746945:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323669248 00000100:00100000:1.0:1787574487.747005:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:1.0:1787574487.747017:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:11423:x1874407323669248:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1787574487.747054:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574487.747075:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb8858 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b81f expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.747174:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb885f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.747189:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb885f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.747200:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb885f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.747213:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8866 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.747220:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.747226:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.747356:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.747367:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e0 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.747374:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.747410:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e0 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.747433:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e0 expref: 22 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574487.747447:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404130a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346817408:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574487.747522:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787574487.753486:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404130a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346817408:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574487.753516:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574487.754966:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.755205:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323669504 00000100:00100000:0.0:1787574487.755214:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323669504 00000100:00100000:0.0:1787574487.755310:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:0.0:1787574487.755321:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:6176:x1874407323669504:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787574487.755530:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:6176:x1874407323669504:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 210us (571us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787574487.755538:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:2.0:1787574487.760898:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574487.761228:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323669632 00000100:00100000:0.0:1787574487.761276:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323669632 00010000:00010000:0.0:1787574487.761315:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e0 expref: 24 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574487.761348:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:0.0:1787574487.761359:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:2405:x1874407323669632:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574487.761590:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574487.761598:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e0 expref: 24 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.761612:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e0 expref: 24 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.761634:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8778 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e0 expref: 24 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.761651:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574487.761660:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.761670:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.761676:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574487.761706:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574487.761762:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:2405:x1874407323669632:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 405us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574487.761770:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00010000:00010000:1.0:1787574487.762185:0:11515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762193:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574487.762268:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787574487.762273:0:11515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574487.762294:0:11515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762306:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762315:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb885f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762321:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb885f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762338:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb885f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762343:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574487.762347:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb885f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762354:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb885f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762363:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:1.0:1787574487.762366:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574487.762370:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb885f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762375:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb885f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762399:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762404:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8866 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762408:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8866 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762412:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574487.762415:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8866 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762427:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8866 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762434:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ca520574c00) 00010000:00010000:1.0:1787574487.762436:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574487.762439:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8866 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762443:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8866 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762479:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb8858 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b81f expref: 23 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762493:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b81f expref: 22 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574487.762500:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:1.0:1787574487.762502:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574487.762505:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19e00, rc 0) 00000100:00100000:1.0:1787574487.762546:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:11423:x1874407323669248:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 15532us (15746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574487.762553:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 141 00000040:00080000:1.0:1787574488.487065:0:14260:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574488.487074:0:14260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574488.487112:0:14260:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787574488.487118:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787574488.755334:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787574488.755371:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574488.755386:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574488.755424:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787574488.755431:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787574488.755556:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404130a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346817536:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787574488.755685:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574488.771674:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574488.771899:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323669760 00000100:00100000:2.0:1787574488.771908:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323669760 00000100:00100000:2.0:1787574488.771965:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:2.0:1787574488.771975:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:11436:x1874407323669760:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787574488.772031:0:6509:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787574488.772145:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:11436:x1874407323669760:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 171us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574488.772152:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:1.0:1787574488.779119:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574488.779375:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323670016 00000100:00100000:3.0:1787574488.779386:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323670016 00000100:00100000:3.0:1787574488.779445:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:3.0:1787574488.779455:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:11436:x1874407323670016:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574488.779476:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574488.779495:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8874 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b826 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574488.779601:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb887b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574488.779616:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb887b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574488.779643:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb887b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574488.779655:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787574488.779772:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8874 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b826 expref: 26 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574488.779790:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb887b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b826 expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574488.780617:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:3.0:1787574488.780623:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574488.780626:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be98c00, rc 0) 00000100:00100000:2.0:1787574488.781354:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:11436:x1874407323670016:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1894us (2239us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787574488.781364:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:0.0:1787574488.783901:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404130a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346817536:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787574488.794413:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574488.794515:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323670144 00000100:00100000:3.0:1787574488.794525:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323670144 00000100:00100000:3.0:1787574488.794590:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1787574488.794600:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:2404:x1874407323670144:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574488.794615:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574488.794638:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb887b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b826 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574488.794657:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:3.0:1787574488.794661:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574488.794717:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:2404:x1874407323670144:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 118us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574488.794724:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:1.0:1787574488.801665:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574488.801981:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323670400 00000100:00100000:0.0:1787574488.801990:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323670400 00000100:00100000:0.0:1787574488.802050:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:0.0:1787574488.802079:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:11436:x1874407323670400:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787574488.802151:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8889 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574488.802180:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8889 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574488.802192:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8889 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574488.802506:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8889 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574488.802515:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8889 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574488.802522:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8889 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574488.802527:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574488.802531:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8889 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574488.802538:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8889 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574488.802550:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574488.802552:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574488.802557:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8889 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574488.802563:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8889 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574488.802734:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:11436:x1874407323670400:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 655us (1076us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787574488.802742:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:2.0:1787574488.806102:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574488.806199:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323670656 00000100:00100000:0.0:1787574488.806210:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323670656 00000100:00100000:0.0:1787574488.806301:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:0.0:1787574488.806311:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:11436:x1874407323670656:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787574488.806530:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:11436:x1874407323670656:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 220us (439us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787574488.806538:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000040:00080000:1.0:1787574488.809864:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574488.809875:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574488.810421:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787574488.810431:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787574489.779211:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574489.841471:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574489.841495:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346817664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574489.841567:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574489.841642:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346817664 00000100:00100000:2.0:1787574489.841650:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346817664 00000100:00100000:2.0:1787574489.841704:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787574489.841716:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3634:x1874407346817664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574489.841758:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787574489.841818:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3634:x1874407346817664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574489.841825:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1787574489.841847:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574489.841886:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f539500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346817664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574489.845316:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574489.845339:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346817792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574489.845425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574489.845594:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346817792 00000100:00100000:3.0:1787574489.845603:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346817792 00000100:00100000:3.0:1787574489.845668:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787574489.845678:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346817792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574489.845701:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787574489.845761:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346817792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574489.845768:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1787574489.845951:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574489.846017:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346817792:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1787574490.494726:0:14311:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787574490.496209:0:14311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787574490.496278:0:14311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787574490.496285:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787574490.702874:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574490.702915:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323670912 00000100:00100000:2.0:1787574490.702925:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323670912 00000100:00100000:2.0:1787574490.702981:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:2.0:1787574490.702991:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:11456:x1874407323670912:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574490.703015:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574490.703037:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8890 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b82d expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574490.706293:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb8897 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574490.706320:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb8897 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574490.706339:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb8897 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574490.706357:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787574490.706502:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8890 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b82d expref: 28 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574490.706525:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb8897 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b82d expref: 27 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574490.706534:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:2.0:1787574490.706537:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787574490.706541:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faa400, rc 0) 00000100:00100000:2.0:1787574490.706615:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:11456:x1874407323670912:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 3625us (3748us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787574490.706636:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00080000:2.0:1787574490.706671:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574490.715941:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574490.716022:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323671040 00000100:00100000:0.0:1787574490.716033:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323671040 00000100:00100000:0.0:1787574490.716161:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:0.0:1787574490.716173:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:11456:x1874407323671040:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:0.0:1787574490.716262:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb88a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574490.716279:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb88a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574490.716290:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb88a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574490.716325:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb88a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574490.716332:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb88a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574490.716354:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb88a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574490.716360:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574490.716364:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb88a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574490.716371:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb88a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574490.716384:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:0.0:1787574490.716495:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574490.716501:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb88a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574490.716509:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10800/0xd18a1efeeddb88a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574490.716615:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:11456:x1874407323671040:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 444us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574490.716624:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 146 00010000:00010000:3.0:1787574490.803477:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574490.815892:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574490.815993:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323671168 00000100:00100000:0.0:1787574490.816004:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323671168 00000100:00100000:0.0:1787574490.816089:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:0.0:1787574490.816102:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323671168:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1787574490.816121:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574490.816150:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000037c87fc/0xd18a1efeeddb88ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b834 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574490.816190:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c38d6, atime: 0x6a8c38d6, ctime: 0x6a8c38d6, blocks: 0x8 00010000:00010000:0.0:1787574490.816210:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=429s v=(0 0) 00010000:00010000:0.0:1787574490.816214:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574490.816223:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000037c87fc/0xd18a1efeeddb88ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b834 expref: 7 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574490.816266:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000037c87fc/0xd18a1efeeddb88ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b834 expref: 7 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574490.816281:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10800, rc 0) 00000100:00100000:0.0:1787574490.816342:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323671168:12345-192.168.202.40@tcp:101:cat.0 Request processed in 244us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574490.816349:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00080000:2.0:1787574490.816916:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574490.823364:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574490.823484:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323671296 00000100:00100000:2.0:1787574490.823495:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323671296 00002000:00100000:2.0:1787574490.823547:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9ca404038a80 x1874407323671296/t0(0) o3->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:261/0 lens 488/0 e 0 to 0 dl 1787574501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574490.823559:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404038a80 with x1874407323671296 ext(0->4095) 00002000:00010000:2.0:1787574490.823565:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca404038a80 00000100:00100000:2.0:1787574490.823600:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:2.0:1787574490.823610:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323671296:12345-192.168.202.40@tcp:3:cat.0 00000100:00100000:2.0:1787574490.823794:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323671296:12345-192.168.202.40@tcp:3:cat.0 Request processed in 185us (442us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787574490.823802:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00002000:00100000:2.0:1787574490.823809:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9ca404038a80 x1874407323671296/t0(0) o3->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:261/0 lens 488/4536 e 0 to 0 dl 1787574501 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574490.823817:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404038a80 with x1874407323671296 ext(0->4095) 00002000:00010000:2.0:1787574490.823820:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca404038a80 00000040:00080000:1.0:1787574491.249930:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787574491.378065:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346817920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574491.378150:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574491.378490:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346817920 00000100:00100000:0.0:1787574491.378500:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346817920 00000100:00100000:0.0:1787574491.378564:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787574491.378575:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346817920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574491.378626:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787574491.378683:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346817920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574491.378691:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787574491.378896:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346817920:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574491.825486:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574491.892453:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346818176:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.892533:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.892585:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346818688:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.892609:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.892630:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346819200:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.892667:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.892691:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787574491.892697:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346818048:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.892722:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.892742:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346818560:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.892766:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.892781:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346819072:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.892816:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.892839:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346819584:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.892863:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.892890:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346818304:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.892913:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.892931:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346818816:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.892952:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.892969:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346819328:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.892990:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.893009:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787574491.893014:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346818432:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.893117:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.893140:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346818944:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.893164:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.893183:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346819456:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.893205:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574491.893262:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346819072 00000100:00100000:1.0:1787574491.893277:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346819072 00000100:00100000:1.0:1787574491.893325:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346819584 00000100:00100000:1.0:1787574491.893328:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346819584 00000100:00100000:1.0:1787574491.893342:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346818944 00000100:00100000:1.0:1787574491.893344:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346818944 00000100:00100000:1.0:1787574491.893357:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346819456 00000100:00100000:1.0:1787574491.893360:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346819456 00000100:00100000:1.0:1787574491.893375:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787574491.893382:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1874407346819072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.893434:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1874407346819072:12345-0@lo:400:kworker.0 Request processed in 52us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.893441:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787574491.893461:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787574491.893466:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346819584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.893494:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346819584:12345-0@lo:400:kworker.0 Request processed in 28us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.893500:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787574491.893512:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787574491.893517:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346818944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.893552:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346818944:12345-0@lo:400:kworker.0 Request processed in 35us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.893557:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787574491.893568:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787574491.893574:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346819456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.893602:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346819456:12345-0@lo:400:kworker.0 Request processed in 28us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.893608:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787574491.893636:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346818560 00000100:00100000:1.0:1787574491.893640:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346818560 00000100:00100000:1.0:1787574491.893663:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346818304 00000100:00100000:1.0:1787574491.893666:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346818304 00000100:00100000:1.0:1787574491.893679:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787574491.893685:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346818560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.893719:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346818560:12345-0@lo:400:kworker.0 Request processed in 35us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.893725:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787574491.893737:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787574491.893742:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346818304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.893767:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346818304:12345-0@lo:400:kworker.0 Request processed in 26us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.893773:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787574491.893790:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346818176 00000100:00100000:1.0:1787574491.893793:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346818176 00000100:00100000:1.0:1787574491.893810:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346818688 00000100:00100000:1.0:1787574491.893813:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346818688 00000100:00100000:1.0:1787574491.893824:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346819200 00000100:00100000:1.0:1787574491.893827:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346819200 00000100:00100000:1.0:1787574491.893836:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346818816 00000100:00100000:1.0:1787574491.893838:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346818816 00000100:00100000:1.0:1787574491.893848:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346819328 00000100:00100000:1.0:1787574491.893850:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346819328 00000100:00100000:1.0:1787574491.893861:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346818432 00000100:00100000:1.0:1787574491.893863:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346818432 00000100:00100000:1.0:1787574491.893874:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787574491.893881:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346818176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.893909:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346818176:12345-0@lo:400:kworker.0 Request processed in 29us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.893924:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787574491.893935:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787574491.893941:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346818688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.893970:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346818688:12345-0@lo:400:kworker.0 Request processed in 30us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.893976:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787574491.893987:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787574491.893992:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346819200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.894018:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346819200:12345-0@lo:400:kworker.0 Request processed in 26us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.894023:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787574491.894204:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787574491.894215:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346818816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574491.894266:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346818816:12345-0@lo:400:kworker.0 Request processed in 54us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574491.894273:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787574491.894287:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787574491.894300:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346819328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574491.894332:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346819328:12345-0@lo:400:kworker.0 Request processed in 33us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574491.894337:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787574491.894350:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787574491.894356:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346818432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574491.894383:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346818432:12345-0@lo:400:kworker.0 Request processed in 27us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574491.894388:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00080000:2.0:1787574491.894410:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574491.894413:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574491.894416:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574491.894419:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574491.894490:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574491.894501:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346819712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574491.894535:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574491.894566:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f53b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346819968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574491.894590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574491.894608:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574491.894613:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346819840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574491.894634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574491.894658:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346819968 00000100:00100000:2.0:1787574491.894663:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346819968 00000100:00100000:2.0:1787574491.894689:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346819840 00000100:00100000:2.0:1787574491.894692:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346819840 00000100:00100000:2.0:1787574491.894705:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787574491.894711:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346819968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574491.894739:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574491.894777:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346819968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574491.894783:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787574491.894796:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787574491.894802:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346819840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574491.894811:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574491.894835:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346819840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574491.894840:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787574491.894877:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1787574491.894883:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1787574491.894902:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca40366f480, transno 4294967302 00000004:00080000:2.0:1787574491.894912:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1787574491.894922:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca404133480, transno 4294967305 00000100:00100000:2.0:1787574491.894932:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346819840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574491.894945:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f53b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346819968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574491.895086:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346819712 00000100:00100000:2.0:1787574491.895091:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346819712 00000100:00100000:2.0:1787574491.895113:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787574491.895119:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346819712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574491.895158:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787574491.895195:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346819712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574491.895201:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787574491.895258:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346819712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574491.896542:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346818432:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.896559:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346818944:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.896572:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346819456:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.896583:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346818304:0@lo:400:kworker.0 00010000:00080000:1.0:1787574491.896598:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40403aa00 x1874407346818816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574491.896608:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346818816:0@lo:400:kworker.0 00010000:00080000:1.0:1787574491.896618:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40403b480 x1874407346819328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574491.896625:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346819328:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.896667:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346818560:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.896692:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346819072:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.896703:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346819584:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.896714:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346818176:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.896724:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346818688:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.896736:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346819200:0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.896796:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346818048 00000100:00100000:1.0:1787574491.896802:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346818048 00000100:00100000:1.0:1787574491.896840:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1787574491.896848:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346818048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574491.896913:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346818048:12345-0@lo:400:kworker.0 Request processed in 65us (4188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.896920:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1787574491.896962:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346818048:0@lo:400:kworker.0 00000040:00080000:1.0:1787574491.897586:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574491.897592:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574491.897613:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787574491.897619:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787574491.934217:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574491.934286:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574491.934323:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574491.934347:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574491.934366:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574491.934383:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574491.934404:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574491.934442:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323671552 00000100:00100000:1.0:1787574491.934452:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323671552 00000100:00100000:1.0:1787574491.934499:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323671680 00000100:00100000:1.0:1787574491.934502:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323671680 00000100:00100000:1.0:1787574491.934523:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323672064 00000100:00100000:1.0:1787574491.934526:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323672064 00000100:00100000:1.0:1787574491.934540:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323672192 00000100:00100000:1.0:1787574491.934542:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323672192 00000100:00100000:1.0:1787574491.934558:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 359 00000100:00100000:1.0:1787574491.934567:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:2402:x1874407323671552:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574491.934655:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:2402:x1874407323671552:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.934663:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 359 00000100:00100000:1.0:1787574491.934684:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 360 00000100:00100000:1.0:1787574491.934690:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323671680:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574491.934713:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323671680:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.934719:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 360 00000100:00100000:1.0:1787574491.934729:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 361 00000100:00100000:1.0:1787574491.934734:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323672064:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574491.934757:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323672064:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.934762:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 361 00000100:00100000:1.0:1787574491.934772:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 362 00000100:00100000:1.0:1787574491.934777:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323672192:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574491.934795:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323672192:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 18us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.934808:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 362 00000100:00100000:1.0:1787574491.934828:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323671808 00000100:00100000:1.0:1787574491.934832:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323671808 00000100:00100000:1.0:1787574491.934852:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323671936 00000100:00100000:1.0:1787574491.934855:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323671936 00000100:00100000:1.0:1787574491.934876:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:1.0:1787574491.934882:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2402:x1874407323671808:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574491.934909:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2402:x1874407323671808:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.934916:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:1.0:1787574491.934927:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:1.0:1787574491.934933:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323671936:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574491.934956:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323671936:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574491.934961:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00080000:1.0:1787574491.934990:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574491.934994:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574491.934996:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574491.935160:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323671424 00000100:00100000:3.0:1787574491.935164:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323671424 00000100:00100000:3.0:1787574491.935197:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 396 00000100:00100000:3.0:1787574491.935204:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2403:x1874407323671424:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574491.935234:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2403:x1874407323671424:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 30us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574491.935254:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 396 00010000:00010000:2.0:1787574492.850887:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574493.874443:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787574493.945388:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1787574493.945400:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787574493.972928:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1787574493.972966:0:6488:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ca5420c7b40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787574493.972973:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca402363d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ca5078b4600 00000020:00080000:1.0:1787574493.972988:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca402363100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ca511517a00 00000020:00080000:1.0:1787574493.973005:0:6488:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:1.0:1787574493.973028:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574493.973052:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574493.973060:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574493.973066:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574493.973072:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574493.973080:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574493.973097:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ca534a4c400) 00010000:00010000:1.0:1787574493.973100:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574493.973105:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574493.973123:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8827 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787574493.973155:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787574493.973227:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1787574494.897974:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574494.962163:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574494.962203:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346820096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574494.962295:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574494.962571:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346820096 00000100:00100000:2.0:1787574494.962579:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346820096 00000100:00100000:2.0:1787574494.962647:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787574494.962659:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346820096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574494.962688:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787574494.962735:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346820096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574494.962743:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787574494.963062:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574494.963075:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346820224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574494.963116:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574494.963190:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346820224 00000100:00100000:3.0:1787574494.963195:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346820224 00000100:00100000:3.0:1787574494.963233:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787574494.963261:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346820224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574494.963272:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787574494.963324:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346820224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574494.963330:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787574494.963405:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1787574494.963410:0:3634:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca53f4b5c00, transno 4294967311 00000004:00080000:1.0:1787574494.963427:0:3634:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1787574494.963454:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346820224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787574494.963560:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574494.963604:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346820096:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787574495.921389:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574496.447522:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574496.447629:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323672320 00000100:00100000:1.0:1787574496.447639:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323672320 00000100:00100000:1.0:1787574496.447780:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:1.0:1787574496.447792:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:11109:x1874407323672320:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787574496.447899:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:11109:x1874407323672320:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 110us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574496.447906:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00080000:0.0:1787574496.448078:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574496.456553:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574496.456968:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323672448 00000100:00100000:1.0:1787574496.456979:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323672448 00000100:00100000:1.0:1787574496.457064:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:1.0:1787574496.457075:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:11109:x1874407323672448:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787574496.457198:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:11109:x1874407323672448:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 124us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574496.457206:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00080000:0.0:1787574496.457291:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574496.461439:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574496.461550:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323672704 00000100:00100000:2.0:1787574496.461560:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323672704 00000100:00100000:2.0:1787574496.461621:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1787574496.461633:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:11109:x1874407323672704:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787574496.461884:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:11109:x1874407323672704:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 252us (453us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787574496.461891:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1787574496.497575:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574496.497600:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346820352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574496.497673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574496.498271:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346820352 00000100:00100000:3.0:1787574496.498281:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346820352 00000100:00100000:3.0:1787574496.498338:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787574496.498349:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346820352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574496.498385:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787574496.498449:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346820352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574496.498465:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787574496.498588:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346820352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574496.573604:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574496.573682:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323672832 00000100:00100000:0.0:1787574496.573693:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323672832 00000100:00100000:0.0:1787574496.573776:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 149 00000100:00100000:0.0:1787574496.573787:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:11914:x1874407323672832:12345-192.168.202.40@tcp:101:lsof.0 00010000:00010000:0.0:1787574496.573808:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574496.573831:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb88b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b83b expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574496.573898:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574496.573913:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574496.573925:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574496.573974:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574496.573978:0:8610:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574496.574018:0:8610:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574496.574057:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb88b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b83b expref: 7 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574496.574075:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b83b expref: 6 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574496.574095:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:0.0:1787574496.574099:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574496.574103:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10200, rc 0) 00000100:00100000:0.0:1787574496.574164:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+6:11914:x1874407323672832:12345-192.168.202.40@tcp:101:lsof.0 Request processed in 379us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574496.574171:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 149 00000100:00080000:1.0:1787574496.574274:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787574496.945494:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574497.009675:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346820480:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.009763:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574497.009830:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346820992:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.009859:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574497.009877:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346821504:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.009911:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574497.009929:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346822016:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.009950:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574497.009973:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787574497.009979:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346820864:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.010003:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574497.010016:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5030be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346821376:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.010033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574497.010045:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40242ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346821888:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.010067:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574497.010201:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346820608:0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.010231:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574497.010277:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346821120:0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.010298:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574497.010316:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346821632:0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.010334:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574497.010350:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346822144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574497.010372:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574497.010391:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787574497.010396:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f53b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346820736:0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.010414:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574497.010429:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346821248:0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.010458:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574497.010489:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346821760:0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.010508:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574497.010532:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346820480 00000100:00100000:1.0:1787574497.010540:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346820480 00000100:00100000:1.0:1787574497.010585:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787574497.010595:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346820480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.010641:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346820480:12345-0@lo:400:kworker.0 Request processed in 47us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.010648:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787574497.010683:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346820992 00000100:00100000:1.0:1787574497.010687:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346820992 00000100:00100000:1.0:1787574497.010706:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346820736 00000100:00100000:1.0:1787574497.010709:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346820736 00000100:00100000:1.0:1787574497.010722:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787574497.010728:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346820992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.010763:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346820992:12345-0@lo:400:kworker.0 Request processed in 35us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.010768:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787574497.010780:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787574497.010786:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346820736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.010823:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346820736:12345-0@lo:400:kworker.0 Request processed in 37us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.010828:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787574497.010847:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346821504 00000100:00100000:1.0:1787574497.010850:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346821504 00000100:00100000:1.0:1787574497.010876:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346822016 00000100:00100000:1.0:1787574497.010886:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346822016 00000100:00100000:1.0:1787574497.010901:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346821376 00000100:00100000:1.0:1787574497.010904:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346821376 00000100:00100000:1.0:1787574497.010915:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346821888 00000100:00100000:1.0:1787574497.010916:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346821888 00000100:00100000:1.0:1787574497.010928:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787574497.010934:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346821504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.010965:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346821504:12345-0@lo:400:kworker.0 Request processed in 31us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.010971:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787574497.010987:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787574497.010992:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346822016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011017:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346822016:12345-0@lo:400:kworker.0 Request processed in 25us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.011023:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787574497.011034:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787574497.011039:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346821376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011064:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346821376:12345-0@lo:400:kworker.0 Request processed in 25us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.011068:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787574497.011078:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787574497.011095:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346821888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011121:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346821888:12345-0@lo:400:kworker.0 Request processed in 28us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.011126:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787574497.011147:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346822144 00000100:00100000:1.0:1787574497.011151:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346822144 00000100:00100000:1.0:1787574497.011181:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787574497.011187:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346822144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574497.011208:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574497.011265:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346822144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.011271:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787574497.011289:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346820864 00000100:00100000:1.0:1787574497.011293:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346820864 00000100:00100000:1.0:1787574497.011310:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346820608 00000100:00100000:1.0:1787574497.011313:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346820608 00000100:00100000:1.0:1787574497.011322:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346821120 00000100:00100000:1.0:1787574497.011325:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346821120 00000100:00100000:1.0:1787574497.011335:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346821632 00000100:00100000:1.0:1787574497.011337:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346821632 00000100:00100000:1.0:1787574497.011346:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346821248 00000100:00100000:1.0:1787574497.011349:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346821248 00000100:00100000:1.0:1787574497.011358:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346821760 00000100:00100000:1.0:1787574497.011361:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346821760 00000100:00100000:1.0:1787574497.011372:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787574497.011378:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346820864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011407:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346820864:12345-0@lo:400:kworker.0 Request processed in 29us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.011413:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787574497.011423:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787574497.011430:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346820608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011452:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346820608:12345-0@lo:400:kworker.0 Request processed in 23us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.011457:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787574497.011467:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787574497.011481:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346821120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011509:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346821120:12345-0@lo:400:kworker.0 Request processed in 30us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.011516:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787574497.011527:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787574497.011532:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346821632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011554:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346821632:12345-0@lo:400:kworker.0 Request processed in 22us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.011559:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787574497.011569:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787574497.011574:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346821248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011595:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346821248:12345-0@lo:400:kworker.0 Request processed in 22us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.011601:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787574497.011609:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787574497.011614:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346821760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011638:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346821760:12345-0@lo:400:kworker.0 Request processed in 23us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.011643:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00080000:1.0:1787574497.011662:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574497.011666:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574497.011669:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574497.011671:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574497.011701:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f53b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346820736:0@lo:400:kworker.0 00010000:00080000:1.0:1787574497.011714:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403484700 x1874407346821248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574497.011736:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346821248:0@lo:400:kworker.0 00010000:00080000:1.0:1787574497.011747:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4f4a80 x1874407346821760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574497.011756:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346821760:0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011765:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346820608:0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011774:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346821120:0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011782:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346821632:0@lo:400:kworker.0 00000100:00100000:1.0:1787574497.011796:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346822144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574497.012297:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346820864:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.012309:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5030be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346821376:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.012319:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40242ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346821888:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.012328:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f53bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346820480:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.012338:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346820992:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.012348:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346821504:0@lo:400:kworker.0 00000100:00100000:2.0:1787574497.012356:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346822016:0@lo:400:kworker.0 00000100:00100000:0.0:1787574497.012522:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346822272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574497.012561:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574497.012607:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346822272 00000100:00100000:0.0:1787574497.012612:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346822272 00000100:00100000:0.0:1787574497.012641:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787574497.012648:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346822272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574497.012660:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574497.012692:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346822272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574497.012699:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787574497.012738:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346822272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574497.012846:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574497.012856:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346822400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574497.012885:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574497.013372:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346822400 00000100:00100000:0.0:1787574497.013378:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346822400 00000100:00100000:0.0:1787574497.013428:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787574497.013434:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346822400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574497.013459:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787574497.013513:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346822400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574497.013520:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787574497.013629:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346822400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574497.033095:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574497.033143:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574497.033174:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574497.033209:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574497.033226:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574497.033277:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574497.033300:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574497.033325:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323673344 00000100:00100000:1.0:1787574497.033334:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323673344 00000100:00100000:1.0:1787574497.033386:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323673472 00000100:00100000:1.0:1787574497.033389:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323673472 00000100:00100000:1.0:1787574497.033408:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:1.0:1787574497.033418:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323673344:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574497.033500:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2403:x1874407323673344:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.033508:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:1.0:1787574497.033526:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:1.0:1787574497.033532:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323673472:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574497.033556:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323673472:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.033561:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00080000:1.0:1787574497.033576:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574497.033580:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574497.033588:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323673088 00000100:00100000:1.0:1787574497.033592:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323673088 00000100:00100000:1.0:1787574497.033612:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323673600 00000100:00100000:1.0:1787574497.033614:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323673600 00000100:00100000:1.0:1787574497.033624:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323673216 00000100:00100000:1.0:1787574497.033626:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323673216 00000100:00100000:1.0:1787574497.033637:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 369 00000100:00100000:1.0:1787574497.033643:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:2403:x1874407323673088:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574497.033677:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:2403:x1874407323673088:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.033684:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 369 00000100:00100000:1.0:1787574497.033694:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323673728 00000100:00100000:1.0:1787574497.033697:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323673728 00000100:00100000:2.0:1787574497.033833:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 370 00000100:00100000:2.0:1787574497.033842:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+6:2403:x1874407323673600:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574497.033876:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+6:2403:x1874407323673600:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574497.033882:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 370 00000100:00100000:2.0:1787574497.033897:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 371 00000100:00100000:2.0:1787574497.033903:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323673216:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574497.033927:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323673216:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574497.033933:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 371 00000100:00100000:1.0:1787574497.036277:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 372 00000100:00100000:1.0:1787574497.036291:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323673728:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574497.036359:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:2403:x1874407323673728:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 72us (3059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574497.036378:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 372 00000100:00100000:3.0:1787574497.036493:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323672960 00000100:00100000:3.0:1787574497.036503:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323672960 00000100:00100000:3.0:1787574497.036545:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 398 00000100:00100000:3.0:1787574497.036552:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2403:x1874407323672960:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574497.036577:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2403:x1874407323672960:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (3369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574497.036583:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 398 00000100:00080000:0.0:1787574497.036822:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787574497.969412:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574498.993484:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787574499.570936:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1787574499.570954:0:6488:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787574499.571081:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787574499.571093:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787574500.018999:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574500.081538:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574500.081563:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346822528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574500.081635:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574500.081994:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346822528 00000100:00100000:0.0:1787574500.082004:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346822528 00000100:00100000:0.0:1787574500.082079:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787574500.082091:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346822528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574500.082120:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787574500.082165:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346822528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574500.082172:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1787574500.082782:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574500.083197:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346822528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574500.083944:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574500.083958:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346822656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574500.084010:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574500.084048:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346822656 00000100:00100000:2.0:1787574500.084066:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346822656 00000100:00100000:2.0:1787574500.084116:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787574500.084125:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346822656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574500.084144:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787574500.084186:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346822656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574500.084193:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1787574500.084211:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574500.084232:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346822656:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787574500.451804:0:14508:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:28:18 (1787574498) 00010000:00010000:2.0:1787574501.054879:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574501.106946:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574501.106956:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574501.107079:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787574501.107088:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787574501.491913:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787574501.622790:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346822784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574501.622917:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574501.622995:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346822784 00000100:00100000:2.0:1787574501.623002:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346822784 00000100:00100000:2.0:1787574501.623072:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787574501.623082:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346822784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574501.623143:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787574501.623193:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346822784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574501.623200:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787574501.623284:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346822784:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787574502.065517:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574502.130168:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346823168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574502.130267:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574502.130439:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346823168 00000100:00100000:1.0:1787574502.130448:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346823168 00000100:00100000:1.0:1787574502.130511:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787574502.130522:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346823168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787574502.130561:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574502.130623:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346823168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574502.130629:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787574502.130675:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346823168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574502.130920:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346823040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574502.130956:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574502.130983:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574502.130989:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346822912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574502.131008:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574502.131210:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346823040 00000100:00100000:1.0:1787574502.131215:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346823040 00000100:00100000:1.0:1787574502.131263:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787574502.131270:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346823040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574502.131293:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574502.131336:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346823040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574502.131341:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787574502.131456:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346823040:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1787574502.131522:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574502.131835:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346822912 00000100:00100000:2.0:1787574502.131840:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346822912 00000100:00100000:2.0:1787574502.131879:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787574502.131886:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca402692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346822912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574502.131897:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574502.131934:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca402692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346822912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574502.131940:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787574502.131968:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346822912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574502.132414:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346823296:0@lo:400:kworker.0 00000100:00100000:3.0:1787574502.132447:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574502.132475:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346823808:0@lo:400:kworker.0 00000100:00100000:3.0:1787574502.132497:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574502.132510:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346824320:0@lo:400:kworker.0 00000100:00100000:3.0:1787574502.132525:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574502.132549:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787574502.132555:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346823680:0@lo:400:kworker.0 00000100:00100000:3.0:1787574502.132693:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574502.132707:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346824192:0@lo:400:kworker.0 00000100:00100000:3.0:1787574502.132726:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574502.132747:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346823296 00000100:00100000:3.0:1787574502.132751:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346823296 00000100:00100000:3.0:1787574502.132776:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1787574502.132781:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346823296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574502.132811:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346823296:12345-0@lo:400:kworker.0 Request processed in 30us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574502.132826:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1787574502.133011:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346823808 00000100:00100000:0.0:1787574502.133016:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346823808 00000100:00100000:0.0:1787574502.133051:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346824320 00000100:00100000:0.0:1787574502.133059:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346824320 00000100:00100000:0.0:1787574502.133087:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346823680 00000100:00100000:0.0:1787574502.133089:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346823680 00000100:00100000:0.0:1787574502.133100:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787574502.133105:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346823808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574502.133137:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346823808:12345-0@lo:400:kworker.0 Request processed in 32us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574502.133142:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787574502.133151:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787574502.133156:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346824320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574502.133175:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346824320:12345-0@lo:400:kworker.0 Request processed in 19us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574502.133530:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346823296:0@lo:400:kworker.0 00000100:00100000:3.0:1787574502.133557:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346823808:0@lo:400:kworker.0 00000100:00100000:0.0:1787574502.133702:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787574502.133716:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787574502.133723:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346823680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574502.133753:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346823680:12345-0@lo:400:kworker.0 Request processed in 32us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574502.133758:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:0.0:1787574502.133771:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574502.133775:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574502.133845:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346823424:0@lo:400:kworker.0 00000100:00100000:2.0:1787574502.133879:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574502.133913:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346823936:0@lo:400:kworker.0 00000100:00100000:2.0:1787574502.133932:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574502.133951:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346824448:0@lo:400:kworker.0 00000100:00100000:2.0:1787574502.133967:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574502.133978:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787574502.133983:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346823552:0@lo:400:kworker.0 00000100:00100000:2.0:1787574502.134000:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574502.134015:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346824064:0@lo:400:kworker.0 00000100:00100000:2.0:1787574502.134030:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574502.134063:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346823424 00000100:00100000:2.0:1787574502.134068:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346823424 00000100:00100000:2.0:1787574502.134090:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346823936 00000100:00100000:2.0:1787574502.134092:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346823936 00000100:00100000:2.0:1787574502.134110:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346824448 00000100:00100000:2.0:1787574502.134112:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346824448 00000100:00100000:2.0:1787574502.134124:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787574502.134129:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346823424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574502.134166:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346823424:12345-0@lo:400:kworker.0 Request processed in 37us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574502.134172:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787574502.134197:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787574502.134204:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346823936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574502.134229:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346823936:12345-0@lo:400:kworker.0 Request processed in 26us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574502.134235:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787574502.134264:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787574502.134270:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346824448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574502.134305:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346824448:12345-0@lo:400:kworker.0 Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574502.135446:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346824320:0@lo:400:kworker.0 00000100:00100000:3.0:1787574502.135511:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346823680:0@lo:400:kworker.0 00000100:00100000:3.0:1787574502.135651:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346823552 00000100:00100000:3.0:1787574502.135658:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346823552 00000100:00100000:3.0:1787574502.135696:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787574502.135703:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346823552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574502.135761:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346823552:12345-0@lo:400:kworker.0 Request processed in 58us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574502.135767:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787574502.135809:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346823552:0@lo:400:kworker.0 00000100:00100000:3.0:1787574502.135822:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346823424:0@lo:400:kworker.0 00010000:00080000:3.0:1787574502.135835:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403746d80 x1874407346823936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574502.135844:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346823936:0@lo:400:kworker.0 00010000:00080000:3.0:1787574502.135854:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403747800 x1874407346824448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574502.135863:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346824448:0@lo:400:kworker.0 00000100:00100000:2.0:1787574502.136055:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787574502.136434:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346824192 00000100:00100000:1.0:1787574502.136439:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346824192 00000100:00100000:1.0:1787574502.136488:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346824064 00000100:00100000:1.0:1787574502.136492:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346824064 00000100:00100000:1.0:1787574502.136521:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787574502.136529:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346824192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574502.136620:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346824192:12345-0@lo:400:kworker.0 Request processed in 91us (3891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574502.136627:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787574502.136640:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787574502.136646:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346824064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574502.136679:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346824064:12345-0@lo:400:kworker.0 Request processed in 33us (2648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574502.136686:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787574502.136726:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346824064:0@lo:400:kworker.0 00000100:00100000:1.0:1787574502.136753:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346824192:0@lo:400:kworker.0 00000100:00080000:0.0:1787574502.136948:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574502.136954:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574502.157349:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574502.157416:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574502.157456:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574502.157579:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323674112 00000100:00100000:0.0:1787574502.157590:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323674112 00000100:00100000:0.0:1787574502.157666:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323673984 00000100:00100000:0.0:1787574502.157670:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323673984 00000100:00100000:0.0:1787574502.157699:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 379 00000100:00100000:0.0:1787574502.157709:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323674112:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574502.157751:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 380 00000100:00100000:2.0:1787574502.157760:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:2403:x1874407323673984:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574502.157841:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323673856 00000100:00100000:1.0:1787574502.157846:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323673856 00000100:00100000:1.0:1787574502.157876:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 400 00000100:00080000:3.0:1787574502.158334:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574502.158340:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574502.158417:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2403:x1874407323674112:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 82us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574502.158429:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 379 00000100:00100000:1.0:1787574502.158599:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2403:x1874407323673856:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574502.163430:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:2403:x1874407323673984:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 5659us (5960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574502.163444:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 380 00000100:00100000:3.0:1787574502.170054:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574502.170136:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574502.170221:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574502.170260:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574502.170296:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323674496 00000100:00100000:3.0:1787574502.170305:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323674496 00000100:00100000:3.0:1787574502.170372:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323674624 00000100:00100000:3.0:1787574502.170375:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323674624 00000100:00100000:3.0:1787574502.170400:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 381 00000100:00100000:3.0:1787574502.170410:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+6:2402:x1874407323674496:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574502.170481:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+6:2402:x1874407323674496:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 72us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574502.170490:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 381 00000100:00100000:3.0:1787574502.170507:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 382 00000100:00100000:3.0:1787574502.170514:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323674624:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574502.170539:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2402:x1874407323674624:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574502.170545:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 382 00000100:00080000:3.0:1787574502.170560:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574502.170563:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574502.170966:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323674240 00000100:00100000:0.0:1787574502.170971:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323674240 00000100:00100000:0.0:1787574502.171009:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323674368 00000100:00100000:0.0:1787574502.171012:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323674368 00000100:00100000:0.0:1787574502.171046:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:0.0:1787574502.171054:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323674240:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574502.171091:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323674240:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574502.171096:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:0.0:1787574502.171109:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:0.0:1787574502.171115:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323674368:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574502.171137:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2402:x1874407323674368:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574502.171143:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00080000:3.0:1787574502.171573:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574502.171578:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574502.171802:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2403:x1874407323673856:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 13205us (14462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574502.171812:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 400 00000100:00100000:0.0:1787574502.198189:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574502.198328:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323674880 00000100:00100000:2.0:1787574502.198344:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323674880 00000100:00100000:2.0:1787574502.198487:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 150 00000100:00100000:2.0:1787574502.198497:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:12181:x1874407323674880:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574502.198516:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574502.198799:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb88c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b842 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.198870:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb88c8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.199561:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb88c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.199647:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb88c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.199743:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb88cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.199771:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb88cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.199778:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb88cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.199874:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb88d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.199997:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb88d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200005:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb88d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574502.200015:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787574502.200104:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb88c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200111:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb88c8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200118:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb88c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200123:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabe00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574502.200128:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb88c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200135:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb88c8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200158:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ca534a4c700) 00010000:00010000:2.0:1787574502.200161:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574502.200167:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb88c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200173:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb88c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200756:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb88cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200766:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb88cf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200772:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb88cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200778:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574502.200781:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb88cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200787:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb88cf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200798:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ca52057fb00) 00010000:00010000:2.0:1787574502.200801:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574502.200804:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb88cf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.200809:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb88cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.202485:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb88c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b842 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.202512:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb88d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b842 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574502.202521:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:2.0:1787574502.202524:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574502.202528:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab400, rc 0) 00000100:00100000:2.0:1787574502.202610:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:12181:x1874407323674880:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 4113us (4431us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787574502.202620:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 150 00000100:00100000:3.0:1787574502.208433:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574502.208540:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574502.208599:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323675008 00000100:00100000:0.0:1787574502.208616:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323675008 00000100:00100000:1.0:1787574502.208785:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323675136 00000100:00100000:1.0:1787574502.208790:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323675136 00000100:00100000:1.0:1787574502.208842:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:1.0:1787574502.208854:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:12181:x1874407323675136:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787574502.208977:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:12181:x1874407323675136:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 124us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574502.208984:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:0.0:1787574502.209478:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1787574502.209490:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:2402:x1874407323675008:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574502.209502:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574502.209523:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb88d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b842 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574502.209556:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:0.0:1787574502.209561:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574502.209598:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:2402:x1874407323675008:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 111us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574502.209605:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1787574502.219301:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574502.219496:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323675264 00000100:00100000:0.0:1787574502.219507:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323675264 00000100:00100000:0.0:1787574502.219565:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:0.0:1787574502.219577:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:12181:x1874407323675264:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787574502.219865:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:12181:x1874407323675264:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 290us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574502.219874:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 152 00000040:00080000:3.0:1787574502.519889:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787574503.091082:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574503.153416:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574503.153424:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574503.153997:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787574503.154006:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787574504.118074:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574504.586682:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574504.586755:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323675392 00000100:00100000:0.0:1787574504.586766:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323675392 00000100:00100000:0.0:1787574504.586831:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 153 00000100:00100000:0.0:1787574504.586842:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:12223:x1874407323675392:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574504.586860:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574504.586902:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb88e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b849 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.586972:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb88eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.586998:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb88eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587009:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb88eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587033:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb88f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587041:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb88f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587047:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb88f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587092:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb88eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587099:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb88eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587105:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb88eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587112:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574504.587118:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb88eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587125:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb88eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587137:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:0.0:1787574504.587145:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574504.587151:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb88eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587157:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb88eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587170:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb88f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587175:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb88f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587180:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb88f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587185:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574504.587188:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb88f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587194:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb88f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587200:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ca534a50d00) 00010000:00010000:0.0:1787574504.587203:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574504.587206:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb88f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587223:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb88f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587277:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb88e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b849 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587299:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:0.0:1787574504.587301:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574504.587306:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb88e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b849 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.587315:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11600, rc 0) 00000100:00100000:0.0:1787574504.587382:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:12223:x1874407323675392:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 542us (709us total) trans 0 rc 301/301 00000100:00100000:0.0:1787574504.587389:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 153 00000100:00080000:3.0:1787574504.587596:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574504.614618:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574504.614687:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323675648 00000100:00100000:3.0:1787574504.614700:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323675648 00000100:00100000:3.0:1787574504.614776:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00100000:3.0:1787574504.614789:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+14:12223:x1874407323675648:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:3.0:1787574504.614865:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574504.614901:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb8238 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b66d expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.614935:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:3.0:1787574504.614940:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574504.615036:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.615053:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b83b expref: 5 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.615063:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.615106:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b83b expref: 5 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.615123:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b83b expref: 5 pid: 8610 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574504.615161:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403745c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346824576:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574504.615297:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574504.620567:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403745c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346824576:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574504.620597:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574504.626212:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574504.629324:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323675776 00000100:00100000:1.0:1787574504.629341:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323675776 00010000:00010000:1.0:1787574504.629409:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b83b expref: 6 pid: 8610 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574504.629504:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:1.0:1787574504.629518:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0874c266-15f3-4d8d-abed-9d908d92af46+6:2404:x1874407323675776:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574504.629537:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574504.629545:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b83b expref: 6 pid: 8610 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787574504.629553:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787574504.629565:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b83b expref: 6 pid: 8610 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.629591:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb88ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b83b expref: 6 pid: 8610 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.629606:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:1.0:1787574504.629611:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.629619:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.629626:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.629663:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574504.629735:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323675776:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 221us (3540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574504.629744:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00010000:00010000:3.0:1787574504.630743:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.630761:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.630799:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.630815:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.630828:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.632046:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.632068:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.632079:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574504.632096:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd35403c reply state 00000000fd407e97 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.632122:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.632129:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574504.632132:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574504.632135:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787574504.632142:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787574504.636640:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.636656:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.636663:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.636668:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be98c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574504.636672:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.636680:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.636697:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599400) 00010000:00010000:3.0:1787574504.636701:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574504.636706:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.636711:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb88f9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574504.636743:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd35403c reply state 00000000fd407e97 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.636757:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.636765:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ca5186ca500) 00010000:00010000:3.0:1787574504.636767:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574504.636771:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787574504.636894:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:12223:x1874407323675648:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 22103us (22289us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787574504.636903:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00100000:3.0:1787574504.762510:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574504.762658:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323675904 00000100:00100000:0.0:1787574504.762669:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323675904 00000100:00100000:0.0:1787574504.762748:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 155 00000100:00100000:0.0:1787574504.762760:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+15:12231:x1874407323675904:12345-192.168.202.40@tcp:101:lctl.0 00010000:00010000:0.0:1787574504.762787:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574504.762810:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb890e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b850 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.762880:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb8915 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.762893:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb8915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.762904:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb8915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574504.762948:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574504.762965:0:11515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574504.762992:0:11515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb8915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.763027:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb890e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b850 expref: 17 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.763044:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb8915 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b850 expref: 16 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.763053:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a50d00) 00010000:00010000:0.0:1787574504.763055:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574504.763059:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10000, rc 0) 00000100:00100000:0.0:1787574504.763130:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:12231:x1874407323675904:12345-192.168.202.40@tcp:101:lctl.0 Request processed in 372us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574504.763137:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 155 00000100:00100000:3.0:1787574504.929335:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574504.929445:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323676032 00000100:00100000:1.0:1787574504.929457:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323676032 00000100:00100000:1.0:1787574504.929523:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00100000:1.0:1787574504.929535:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:12237:x1874407323676032:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574504.929558:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574504.929579:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb891c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b857 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929656:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8923 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929671:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929685:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929697:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb892a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929704:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb892a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929711:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb892a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929810:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8931 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929839:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929847:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574504.929886:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787574504.929890:0:8610:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574504.929911:0:8610:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929924:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929940:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8923 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929946:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8923 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929952:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574504.929956:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8923 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929964:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8923 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.929976:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a50d00) 00010000:00010000:1.0:1787574504.929979:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574504.929983:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.930000:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.930025:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb892a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.930031:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb892a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.930037:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb892a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.930041:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574504.930044:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb892a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.930050:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb892a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.930058:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ca5186ca500) 00010000:00010000:1.0:1787574504.930061:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574504.930063:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb892a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.930069:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb892a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.930095:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb891c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b857 expref: 18 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.930108:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8931 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b857 expref: 17 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574504.930123:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:1.0:1787574504.930125:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787574504.930128:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e18e00, rc 0) 00000100:00100000:1.0:1787574504.930198:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:12237:x1874407323676032:12345-192.168.202.40@tcp:101:bash.0 Request processed in 664us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574504.930206:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00100000:2.0:1787574504.941586:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574504.942216:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323676288 00000100:00100000:3.0:1787574504.942227:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323676288 00000100:00100000:3.0:1787574504.942331:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 157 00000100:00100000:3.0:1787574504.942343:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:12237:x1874407323676288:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1787574504.942362:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574504.942384:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8938 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b85e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.942491:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb893f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.942506:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb893f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.942517:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb893f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.942601:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.942610:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.942617:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787574504.942973:0:6509:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787574504.943124:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb894d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943134:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb894d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943141:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb894d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943172:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb893f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943179:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb893f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943186:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb893f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943191:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be98800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574504.943196:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb893f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943215:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb893f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943228:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574504.943230:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574504.943235:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb893f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943269:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98800/0xd18a1efeeddb893f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574504.943282:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6ea1194 reply state 00000000ac1e15a1 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943293:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943299:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca300) 00010000:00010000:3.0:1787574504.943301:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574504.943304:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787574504.943334:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be98c00/0xd18a1efeeddb8938 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b85e expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943348:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb894d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b85e expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.943356:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186cad00) 00010000:00010000:3.0:1787574504.943358:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574504.943360:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb200, rc 0) 00000100:00100000:3.0:1787574504.943442:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:12237:x1874407323676288:12345-192.168.202.40@tcp:101:bash.0 Request processed in 1102us (1865us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787574504.943458:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 157 00000100:00100000:2.0:1787574504.950202:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574504.950738:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323676416 00000100:00100000:0.0:1787574504.950749:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323676416 00000100:00100000:0.0:1787574504.950866:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:0.0:1787574504.950881:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323676416:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1787574504.950899:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574504.950922:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0b8f068/0xd18a1efeeddb895b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b865 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574504.950963:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574504.950986:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1787574504.950991:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574504.951001:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0b8f068/0xd18a1efeeddb895b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b865 expref: 6 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.951859:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e0b8f068/0xd18a1efeeddb895b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b865 expref: 6 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.951877:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11a00, rc 0) 00000100:00100000:0.0:1787574504.951962:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323676416:12345-192.168.202.40@tcp:101:bash.0 Request processed in 1085us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574504.951971:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00080000:3.0:1787574504.956149:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574504.956509:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574504.956587:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323676544 00000100:00100000:0.0:1787574504.956598:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323676544 00000100:00100000:0.0:1787574504.956667:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:0.0:1787574504.956678:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:12237:x1874407323676544:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1787574504.956696:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574504.956716:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b86c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.956749:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0b8f068/0xd18a1efeeddb895b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b865 expref: 7 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.956759:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574504.956763:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574504.956768:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.956804:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0b8f068/0xd18a1efeeddb895b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b865 expref: 7 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.956834:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0b8f068/0xd18a1efeeddb895b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b865 expref: 7 pid: 8423 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574504.956848:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1874407346824704:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574504.956960:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574504.963594:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1874407346824704:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574504.963634:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574504.963663:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11600, rc 0) 00000100:00100000:0.0:1787574504.963729:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:12237:x1874407323676544:12345-192.168.202.40@tcp:101:bash.0 Request processed in 7052us (7225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574504.963737:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:1.0:1787574504.966390:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574504.966491:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323676672 00000100:00100000:3.0:1787574504.966502:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323676672 00010000:00010000:3.0:1787574504.966547:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0b8f068/0xd18a1efeeddb895b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b865 expref: 7 pid: 8423 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574504.966593:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:3.0:1787574504.966605:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323676672:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574504.966620:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574504.966642:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0b8f068/0xd18a1efeeddb895b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b865 expref: 7 pid: 8423 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.966665:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0b8f068/0xd18a1efeeddb895b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b865 expref: 7 pid: 8423 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.966688:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0b8f068/0xd18a1efeeddb895b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b865 expref: 7 pid: 8423 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.966705:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574504.966709:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574504.966715:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.966725:0:7451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574504.966779:0:7451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574504.966793:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7451:1874407346824832:192.168.202.40@tcp:105: 00000100:00100000:3.0:1787574504.966879:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53525f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787574504.973070:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7451:1874407346824832:192.168.202.40@tcp:105: 00010000:00010000:3.0:1787574504.973105:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574504.973164:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2405:x1874407323676672:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 6561us (6784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574504.973175:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:1.0:1787574504.983557:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574504.983647:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323676928 00000100:00100000:3.0:1787574504.983663:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323676928 00000100:00100000:3.0:1787574504.983725:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:3.0:1787574504.983736:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:12237:x1874407323676928:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:3.0:1787574504.984059:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:12237:x1874407323676928:12345-192.168.202.40@tcp:35:bash.0 Request processed in 324us (511us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787574504.984068:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:1.0:1787574505.106512:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574505.106614:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323677184 00000100:00100000:0.0:1787574505.106626:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323677184 00000100:00100000:0.0:1787574505.106700:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:0.0:1787574505.106712:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:12247:x1874407323677184:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574505.106759:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574505.106780:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8969 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b873 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574505.106879:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787574505.106980:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8969 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b873 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.107018:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a50d00) 00010000:00010000:0.0:1787574505.107021:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574505.107028:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8969 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b873 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.107045:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10200, rc 0) 00000100:00100000:0.0:1787574505.107114:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:12247:x1874407323677184:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 404us (612us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1787574505.107121:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:1.0:1787574505.112904:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574505.112974:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323677440 00000100:00100000:3.0:1787574505.112983:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323677440 00000100:00100000:3.0:1787574505.113039:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:3.0:1787574505.113051:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:12247:x1874407323677440:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1787574505.113266:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:12247:x1874407323677440:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 193us (347us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787574505.113287:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00010000:00010000:2.0:1787574505.142706:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574505.202449:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346824960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574505.202577:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574505.203048:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346824960 00000100:00100000:2.0:1787574505.203058:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346824960 00000100:00100000:2.0:1787574505.203129:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787574505.203140:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346824960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574505.203172:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787574505.203230:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346824960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574505.203277:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787574505.203325:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346824960:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787574505.203572:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574505.208293:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346825088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574505.208395:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574505.208623:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346825088 00000100:00100000:0.0:1787574505.208632:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346825088 00000100:00100000:0.0:1787574505.208693:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787574505.208703:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346825088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574505.208920:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787574505.208976:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346825088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 273us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574505.208983:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787574505.209044:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346825088:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787574505.209065:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574505.222104:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574505.222186:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323677568 00000100:00100000:3.0:1787574505.222197:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323677568 00000100:00100000:3.0:1787574505.222275:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 159 00000100:00100000:3.0:1787574505.222285:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:12253:x1874407323677568:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574505.222308:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574505.222329:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8977 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b87a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.222393:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb897e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.222406:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb897e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.222429:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb897e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574505.222473:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787574505.222476:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574505.222494:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb897e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.222536:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8977 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b87a expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.222555:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb897e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b87a expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.222563:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574505.222565:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574505.222569:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb600, rc 0) 00000100:00100000:3.0:1787574505.222983:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:12253:x1874407323677568:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 696us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574505.222991:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 159 00000100:00100000:1.0:1787574505.237203:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574505.237337:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323677824 00000100:00100000:0.0:1787574505.237348:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323677824 00000100:00100000:0.0:1787574505.237426:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 160 00000100:00100000:0.0:1787574505.237437:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:12253:x1874407323677824:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574505.237456:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574505.237476:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8985 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b881 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.237597:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb898c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.237610:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb898c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.237621:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb898c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574505.237631:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787574505.237751:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb8985 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b881 expref: 27 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.237768:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb898c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b881 expref: 26 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.237776:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186cad00) 00010000:00010000:0.0:1787574505.237779:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574505.237782:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11800, rc 0) 00000100:00100000:0.0:1787574505.238182:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+26:12253:x1874407323677824:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 745us (987us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1787574505.238191:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 160 00000100:00100000:1.0:1787574505.249037:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574505.249086:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574505.249181:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323678080 00000100:00100000:0.0:1787574505.249191:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323678080 00000100:00100000:0.0:1787574505.249282:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 161 00000100:00100000:0.0:1787574505.249294:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+26:12253:x1874407323678080:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574505.249318:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574505.249352:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb899a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b888 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.249467:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.249482:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.249493:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574505.249505:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787574505.249601:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb899a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b888 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.249619:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b888 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.249628:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186cad00) 00010000:00010000:0.0:1787574505.249631:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787574505.249634:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11a00, rc 0) 00000100:00100000:0.0:1787574505.249697:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+28:12253:x1874407323678080:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 406us (671us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1787574505.249704:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 161 00000100:00100000:2.0:1787574505.250222:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323678208 00000100:00100000:2.0:1787574505.250229:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323678208 00000100:00100000:2.0:1787574505.250300:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:2.0:1787574505.250309:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+28:2403:x1874407323678208:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574505.250320:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574505.250336:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb898c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b881 expref: 28 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574505.250349:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186cad00) 00010000:00010000:2.0:1787574505.250352:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574505.250387:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:2403:x1874407323678208:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 79us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574505.250394:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:1.0:1787574505.260653:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574505.260758:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323678336 00000100:00100000:0.0:1787574505.260769:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323678336 00000100:00100000:0.0:1787574505.260827:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:0.0:1787574505.260838:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323678336:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:0.0:1787574505.260900:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.260921:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.260931:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574505.260935:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787574505.260940:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.260977:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.260992:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 6 pid: 8425 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574505.261018:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874407346825216:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574505.261113:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574505.269464:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874407346825216:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574505.269496:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574505.276630:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574505.276835:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323678464 00000100:00100000:2.0:1787574505.276846:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323678464 00002000:00100000:2.0:1787574505.276896:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9ca53f538700 x1874407323678464/t0(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:276/0 lens 504/0 e 0 to 0 dl 1787574516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574505.276907:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca53f538700 with x1874407323678464 ext(0->12) 00010000:00010000:2.0:1787574505.276917:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 7 pid: 8425 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574505.276947:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 7 pid: 8425 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574505.276975:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ca53f538700 00000100:00100000:2.0:1787574505.277017:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:2.0:1787574505.277027:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323678464:12345-192.168.202.40@tcp:4:lfs.0 00000100:00100000:2.0:1787574505.278289:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2405:x1874407323678464:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 1256us (1663us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787574505.278299:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00002000:00100000:2.0:1787574505.278308:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9ca53f538700 x1874407323678464/t4294967306(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:276/0 lens 504/448 e 0 to 0 dl 1787574516 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574505.278317:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca53f538700 with x1874407323678464 ext(0->12) 00010000:00010000:2.0:1787574505.278325:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 9 pid: 8425 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574505.278341:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 9 pid: 8425 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574505.278348:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ca53f538700 00000100:00100000:1.0:1787574505.286365:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574505.286473:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323678592 00000100:00100000:0.0:1787574505.286485:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323678592 00010000:00010000:0.0:1787574505.286530:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 9 pid: 8425 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574505.286595:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:0.0:1787574505.286606:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2404:x1874407323678592:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574505.286622:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787574505.286656:0:6495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787574505.286660:0:6495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787574504 00002000:00010000:0.0:1787574505.286663:0:6495:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787574504 00002000:00010000:0.0:1787574505.286665:0:6495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787574504 00002000:00010000:0.0:1787574505.286667:0:6495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787574505.286674:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 9 pid: 8425 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.286688:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 9 pid: 8425 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.286711:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5484790/0xd18a1efeeddb8962 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b86c expref: 9 pid: 8425 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.286728:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787574505.286745:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787574505.286752:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.286763:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.286811:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574505.286878:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323678592:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 274us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574505.286886:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00010000:00010000:1.0:1787574505.286970:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.286988:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.287019:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.287034:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.287042:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.287048:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c10200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574505.287052:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.287061:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.287073:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.287080:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4930fe5/0xd18a1efeeddb89af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574505.287130:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323678336:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 26294us (26498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574505.287137:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:3.0:1787574505.290003:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574505.290079:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323678848 00000100:00100000:0.0:1787574505.290088:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323678848 00000100:00100000:0.0:1787574505.290155:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:0.0:1787574505.290167:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b65b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:12253:x1874407323678848:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:0.0:1787574505.290227:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b888 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574505.290458:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1787574505.290494:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787574505.291194:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1787574505.291273:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.291290:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb894d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b85e expref: 31 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.291300:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.291335:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb894d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b85e expref: 31 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.291352:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb894d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b85e expref: 31 pid: 6509 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574505.291384:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6513:1874407346825344:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574505.291486:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787574505.296676:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574505.296882:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6513:1874407346825344:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574505.296912:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574505.300176:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323678976 00000100:00100000:1.0:1787574505.300192:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323678976 00010000:00010000:1.0:1787574505.300291:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb894d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b85e expref: 32 pid: 6509 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574505.300346:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:1.0:1787574505.300357:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:2405:x1874407323678976:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574505.300373:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574505.300380:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb894d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b85e expref: 32 pid: 6509 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.300395:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb894d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b85e expref: 32 pid: 6509 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.300495:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb894d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b85e expref: 32 pid: 6509 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.300516:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186cad00) 00010000:00010000:1.0:1787574505.300522:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.300533:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.300541:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.300582:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574505.300636:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.300645:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574505.300659:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+31:2405:x1874407323678976:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 302us (3984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574505.300668:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00000001:00080000:3.0:1787574505.300828:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1787574505.300937:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1787574505.301117:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346825472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787574505.301274:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574505.301304:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574505.301326:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346825472 00000100:00100000:3.0:1787574505.301331:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346825472 00000100:00100000:3.0:1787574505.301370:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787574505.301378:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1874407346825472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787574505.301464:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1874407346825472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574505.301471:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1787574505.301490:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574505.301516:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346825472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787574505.301958:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1787574505.302293:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346825600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787574505.302331:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574505.302351:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53525f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574505.303121:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346825600 00000100:00100000:1.0:1787574505.303139:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346825600 00000100:00100000:1.0:1787574505.303188:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787574505.303197:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1874407346825600:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787574505.303354:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6513:x1874407346825600:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 157us (1021us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787574505.303362:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787574505.303393:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346825600:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787574505.303445:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1787574505.303481:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.303491:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.303499:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.303508:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574505.303512:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.303519:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.303545:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186cad00) 00010000:00010000:3.0:1787574505.303549:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787574505.303560:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.303567:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89b6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787574505.303682:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787574505.303744:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787574505.303756:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 444486515013ns, next at 445486513083ns, rc = 0 00000001:00080000:3.0:1787574505.303762:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1787574505.303783:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186cad00) 00010000:00010000:3.0:1787574505.303787:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787574505.303793:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89a1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b888 expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574505.303888:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b65b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:12253:x1874407323678848:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 13723us (13903us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787574505.303895:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000020:00080000:3.0:1787574505.303898:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787574505.307754:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574505.307869:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323679104 00000100:00100000:3.0:1787574505.307879:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323679104 00000100:00100000:3.0:1787574505.307950:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:3.0:1787574505.307960:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:12253:x1874407323679104:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574505.307998:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574505.308029:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb89bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b88f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.308085:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb89bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b88f expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.308129:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb89bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b88f expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574505.308149:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:3.0:1787574505.308152:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574505.308156:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa400, rc 0) 00000100:00100000:3.0:1787574505.308227:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:12253:x1874407323679104:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 268us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574505.308234:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:2.0:1787574505.316310:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574505.316695:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323679360 00000100:00100000:0.0:1787574505.316706:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323679360 00000100:00100000:0.0:1787574505.316906:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1787574505.316919:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:12253:x1874407323679360:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1787574505.317214:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+36:12253:x1874407323679360:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 298us (913us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787574505.317224:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:2.0:1787574505.453750:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574505.453866:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323679616 00000100:00100000:0.0:1787574505.453877:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323679616 00000100:00100000:0.0:1787574505.453942:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:0.0:1787574505.453954:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+36:12264:x1874407323679616:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574505.453976:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574505.454018:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb89c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b896 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574505.454115:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787574505.454671:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb89c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b896 expref: 38 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.454707:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a50d00) 00010000:00010000:0.0:1787574505.454710:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574505.454716:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb89c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b896 expref: 38 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.454730:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11600, rc 0) 00000100:00100000:0.0:1787574505.454838:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12264:x1874407323679616:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 886us (1097us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1787574505.454847:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:0.0:1787574505.475886:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574505.476075:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323679744 00000100:00100000:1.0:1787574505.476086:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323679744 00000100:00100000:1.0:1787574505.476153:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:1.0:1787574505.476164:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12264:x1874407323679744:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:1.0:1787574505.476278:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb89d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476294:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb89d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476306:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb89d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476317:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb89d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476325:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb89d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476332:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb89d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476412:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb89e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476434:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb89e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476441:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb89e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574505.476489:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb89e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476502:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb89d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476508:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb89d2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476515:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb89d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476521:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574505.476526:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb89d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476533:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb89d2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476804:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:1.0:1787574505.476807:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574505.476812:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb89d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476819:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb89d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476841:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb89d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476847:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb89d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476852:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb89d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476857:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574505.476860:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb89d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476866:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb89d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476874:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca300) 00010000:00010000:1.0:1787574505.476876:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574505.476879:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb89d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476884:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb89d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476893:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb89e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476899:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb89e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476904:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb89e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476915:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574505.476918:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb89e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.476998:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb89e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.477017:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:1.0:1787574505.477020:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574505.477023:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb89e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574505.477029:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb89e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574505.477116:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12264:x1874407323679744:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 952us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574505.477124:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:2.0:1787574505.480374:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574505.480453:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323680000 00000100:00100000:3.0:1787574505.480463:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323680000 00000100:00100000:3.0:1787574505.480520:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:3.0:1787574505.480531:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12264:x1874407323680000:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1787574505.480805:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:12264:x1874407323680000:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 275us (440us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787574505.480813:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:3.0:1787574505.565339:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574505.565432:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323680256 00000100:00100000:0.0:1787574505.565442:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323680256 00000100:00100000:0.0:1787574505.565504:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:0.0:1787574505.565516:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:12267:x1874407323680256:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574505.565553:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574505.565576:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb89e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b89d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565651:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565666:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565678:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565710:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565718:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565726:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565835:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb89fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565844:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb89fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565852:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb89fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574505.565862:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787574505.565947:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565956:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565963:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565969:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574505.565973:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.565991:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566019:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:0.0:1787574505.566022:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574505.566028:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566033:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb89ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566046:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566052:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566058:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566064:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574505.566066:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566072:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566078:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca300) 00010000:00010000:0.0:1787574505.566081:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574505.566084:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566099:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb89f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566136:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb89e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b89d expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566149:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb89fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b89d expref: 40 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.566157:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574505.566160:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574505.566162:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c10200, rc 0) 00000100:00100000:0.0:1787574505.566450:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12267:x1874407323680256:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 934us (1119us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787574505.566458:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:2.0:1787574505.574296:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574505.580615:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323680384 00000100:00100000:0.0:1787574505.580632:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323680384 00000100:00100000:0.0:1787574505.580699:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:0.0:1787574505.580710:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12267:x1874407323680384:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:0.0:1787574505.580779:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.580791:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.580799:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.580846:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.580850:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.580855:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.580859:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574505.580862:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.580866:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.580874:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574505.580876:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574505.580879:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574505.580883:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574505.580962:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12267:x1874407323680384:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 255us (6675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574505.580967:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:2.0:1787574505.586895:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574505.587002:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323680640 00000100:00100000:3.0:1787574505.587021:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323680640 00000100:00100000:3.0:1787574505.587074:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:3.0:1787574505.587083:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12267:x1874407323680640:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1787574505.587304:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+41:12267:x1874407323680640:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 222us (417us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787574505.587310:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:3.0:1787574506.045710:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574506.045904:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323680896 00000100:00100000:2.0:1787574506.045913:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323680896 00000100:00100000:2.0:1787574506.046076:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:2.0:1787574506.046088:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+41:12298:x1874407323680896:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:2.0:1787574506.046112:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574506.046132:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8a4 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.046291:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8a18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.046306:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8a18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.046318:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8a18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574506.046329:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787574506.046435:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8a4 expref: 44 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.046457:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8a18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8a4 expref: 43 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.046465:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574506.046468:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574506.046472:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faba00, rc 0) 00000100:00100000:2.0:1787574506.046539:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:12298:x1874407323680896:12345-192.168.202.40@tcp:101:cat.0 Request processed in 453us (840us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787574506.046546:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00080000:3.0:1787574506.048559:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574506.053409:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574506.053515:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574506.053603:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323681280 00000100:00100000:0.0:1787574506.053614:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323681280 00000100:00100000:0.0:1787574506.053694:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1787574506.053712:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5030be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:2402:x1874407323681280:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574506.053742:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574506.053767:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8a18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8a4 expref: 43 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.053787:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574506.053790:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574506.053848:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5030be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+42:2402:x1874407323681280:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 138us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574506.053855:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:3.0:1787574506.054985:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323681152 00000100:00100000:3.0:1787574506.054995:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323681152 00000100:00100000:3.0:1787574506.055056:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:3.0:1787574506.055065:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40242ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+42:12298:x1874407323681152:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:3.0:1787574506.055314:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40242ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:12298:x1874407323681152:12345-192.168.202.40@tcp:35:cat.0 Request processed in 249us (1914us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1787574506.055322:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:2.0:1787574506.143644:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574506.143777:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323681536 00000100:00100000:0.0:1787574506.143788:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323681536 00000100:00100000:0.0:1787574506.143857:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:0.0:1787574506.143870:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:12304:x1874407323681536:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:0.0:1787574506.143894:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574506.143897:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787574506.143932:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb897e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b87a expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.143953:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:0.0:1787574506.143968:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574506.144501:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a26 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8ab expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.144616:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.144645:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb89fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b89d expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.144654:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.144691:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb89fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b89d expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.144706:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb89fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b89d expref: 43 pid: 6510 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574506.144722:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346825728:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574506.144827:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574506.149565:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574506.149743:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346825728:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574506.149771:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574506.149849:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323681664 00000100:00100000:2.0:1787574506.149857:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323681664 00010000:00010000:2.0:1787574506.149892:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb89fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b89d expref: 44 pid: 6510 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574506.149940:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:2.0:1787574506.149951:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+44:2404:x1874407323681664:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574506.149979:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574506.149987:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb89fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b89d expref: 44 pid: 6510 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.150027:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb89fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b89d expref: 44 pid: 6510 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.150051:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10200/0xd18a1efeeddb89fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b89d expref: 44 pid: 6510 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.150068:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574506.150072:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.150081:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.150089:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.150136:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574506.150449:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.150457:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574506.150476:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787574506.150609:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11600/0xd18a1efeeddb8a26 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ab expref: 45 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.150625:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ab expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.150632:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:3.0:1787574506.150635:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574506.150638:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca535c11800, rc 0) 00000100:00100000:3.0:1787574506.150689:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+44:12304:x1874407323681536:12345-192.168.202.40@tcp:101:dd.0 Request processed in 6823us (7056us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787574506.150697:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:2.0:1787574506.151555:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:2404:x1874407323681664:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 1600us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574506.151566:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:1.0:1787574506.154451:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000001:00080000:1.0:1787574506.157235:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000004:00080000:1.0:1787574506.157299:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787574506.157315:0:6488:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ca5353b2780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787574506.157320:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca506508800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ca5353b2d80 00000020:00080000:1.0:1787574506.157323:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca506508d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ca503015000 00000020:00080000:1.0:1787574506.157361:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787574506.157421:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787574506.157610:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157622:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157629:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157635:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574506.157640:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157648:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157664:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ca5186ca500) 00010000:00010000:2.0:1787574506.157667:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574506.157672:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157678:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99a00/0xd18a1efeeddb8900 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157698:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157721:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157726:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157731:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574506.157734:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157739:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157748:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:2.0:1787574506.157751:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574506.157754:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157758:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be99e00/0xd18a1efeeddb8907 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157773:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157780:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157785:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157791:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574506.157800:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157806:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157814:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca300) 00010000:00010000:2.0:1787574506.157816:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574506.157819:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.157824:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8946 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574506.157859:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574506.157876:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346825856:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787574506.157952:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574506.158163:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346825856 00000100:00100000:3.0:1787574506.158170:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346825856 00000100:00100000:3.0:1787574506.158229:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787574506.158262:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346825856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787574506.158291:0:8619:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1787574506.158322:0:8619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c38e8, atime: 0x6a8c38e8, ctime: 0x6a8c38e8, blocks: 0x8 00010000:00010000:3.0:1787574506.158329:0:8619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099e148b9/0xd18a1efeeddb8a3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.158342:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=445s v=(0 0) 00010000:00010000:3.0:1787574506.158347:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574506.158353:0:8619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099e148b9/0xd18a1efeeddb8a3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.158368:0:8619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099e148b9/0xd18a1efeeddb8a3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.158376:0:8619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099e148b9/0xd18a1efeeddb8a3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.158382:0:8619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099e148b9/0xd18a1efeeddb8a3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.158400:0:8619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787574506.158520:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3634:x1874407346825856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 282us (567us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787574506.158526:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1787574506.158554:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574506.158559:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099e148b9/0xd18a1efeeddb8a3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.158565:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574506.158569:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099e148b9/0xd18a1efeeddb8a3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.158577:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099e148b9/0xd18a1efeeddb8a3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.158588:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099e148b9/0xd18a1efeeddb8a3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.158595:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099e148b9/0xd18a1efeeddb8a3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.158610:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574506.158611:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574506.158613:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787574506.160404:0:3634:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca4040a4700/2, rc 0, transno 4294967308 00000100:00100000:2.0:1787574506.160418:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346825856:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787574506.164304:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323681792 00000100:00100000:0.0:1787574506.164322:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323681792 00000100:00100000:0.0:1787574506.164459:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:0.0:1787574506.164471:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+16:12304:x1874407323681792:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:0.0:1787574506.164498:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574506.164519:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8a42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8b2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.164556:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8a49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.164583:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8a49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.164593:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8a49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.164714:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11a00/0xd18a1efeeddb8a42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b2 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.164734:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8a49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b2 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.164744:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574506.164747:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574506.164750:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030800, rc 0) 00000100:00100000:0.0:1787574506.164821:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:12304:x1874407323681792:12345-192.168.202.40@tcp:101:dd.0 Request processed in 352us (10377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574506.164828:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 169 00010000:00010000:3.0:1787574506.165172:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574506.174049:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574506.174124:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323682048 00000100:00100000:0.0:1787574506.174133:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323682048 00000100:00100000:0.0:1787574506.174195:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 170 00000100:00100000:0.0:1787574506.174205:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+17:12304:x1874407323682048:12345-192.168.202.40@tcp:36:dd.0 00010000:00010000:0.0:1787574506.174473:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.174491:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.174519:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574506.174562:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1787574506.174585:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014d1fdd7 reply state 000000002de3de5b transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.174599:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.174607:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574506.174610:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574506.174613:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574506.174687:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:12304:x1874407323682048:12345-192.168.202.40@tcp:36:dd.0 Request processed in 482us (647us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1787574506.174694:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 170 00000020:00080000:0.0:1787574506.174699:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787574506.720840:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574506.721650:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323682176 00000100:00100000:3.0:1787574506.721662:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323682176 00000100:00100000:3.0:1787574506.721733:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 171 00000100:00100000:3.0:1787574506.721745:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:12318:x1874407323682176:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:3.0:1787574506.721771:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574506.721791:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8a57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8b9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.721870:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8a5e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.721885:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8a5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.721896:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8a5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.721921:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8a65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.721928:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.721934:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.722020:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.722031:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ab expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.722040:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.722074:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ab expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.722098:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ab expref: 21 pid: 6510 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574506.722111:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346825984:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574506.722222:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574506.726226:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346825984:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574506.726273:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574506.727760:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574506.727825:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323682432 00000100:00100000:3.0:1787574506.727834:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323682432 00000100:00100000:3.0:1787574506.727903:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:3.0:1787574506.727922:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:6177:x1874407323682432:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787574506.728269:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:6177:x1874407323682432:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 348us (514us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1787574506.728276:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:1.0:1787574506.733664:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574506.733804:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323682560 00000100:00100000:0.0:1787574506.733815:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323682560 00010000:00010000:0.0:1787574506.733860:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ab expref: 23 pid: 6510 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574506.733966:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:0.0:1787574506.733979:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:2405:x1874407323682560:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574506.734004:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574506.734012:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ab expref: 23 pid: 6510 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.734043:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ab expref: 23 pid: 6510 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.734066:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11800/0xd18a1efeeddb8a2d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ab expref: 23 pid: 6510 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.734083:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574506.734089:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.734099:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.734115:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574506.734144:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574506.734179:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734187:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574506.734204:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:2405:x1874407323682560:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 229us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574506.734211:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00000004:00200000:3.0:1787574506.734262:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787574506.734267:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574506.734290:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734313:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734322:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8a5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734328:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8a5e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734334:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8a5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734340:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574506.734344:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8a5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734352:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8a5e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734361:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574506.734364:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574506.734367:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8a5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734373:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8a5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734384:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734390:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8a65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734402:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8a65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734406:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574506.734409:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8a65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734415:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8a65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734423:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186cad00) 00010000:00010000:3.0:1787574506.734425:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574506.734427:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8a65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734433:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8a65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734470:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8a57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b9 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734485:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b9 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574506.734492:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:3.0:1787574506.734494:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574506.734497:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421faa00, rc 0) 00000100:00100000:3.0:1787574506.734536:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:12318:x1874407323682176:12345-192.168.202.40@tcp:101:stat.0 Request processed in 12794us (13705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574506.734553:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 171 00000100:00100000:2.0:1787574506.741210:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574506.741236:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346826112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574506.741324:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574506.741489:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346826112 00000100:00100000:3.0:1787574506.741498:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346826112 00000100:00100000:3.0:1787574506.741560:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787574506.741569:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346826112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574506.741604:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787574506.741657:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346826112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574506.741664:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787574506.741753:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346826112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574506.834781:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574506.835036:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323682816 00000100:00100000:2.0:1787574506.835047:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323682816 00000100:00100000:2.0:1787574506.835307:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:2.0:1787574506.835319:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:12324:x1874407323682816:12345-192.168.202.40@tcp:36:truncate.0 00010000:00010000:2.0:1787574506.835378:0:8610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574506.835422:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8a6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b9 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.835440:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574506.835444:0:8610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574506.835620:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.835633:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.835642:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574506.835683:0:8610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1787574506.835703:0:8610:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea563c48 reply state 0000000079f3457e transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.835716:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574506.835723:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574506.835725:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787574506.835728:0:8610:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574506.835834:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:12324:x1874407323682816:12345-192.168.202.40@tcp:36:truncate.0 Request processed in 517us (1072us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787574506.835842:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 172 00000020:00080000:2.0:1787574506.835847:0:8610:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787574507.085370:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574507.085454:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323682944 00000100:00100000:2.0:1787574507.085466:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323682944 00000100:00100000:2.0:1787574507.085532:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:2.0:1787574507.085542:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:12338:x1874407323682944:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:2.0:1787574507.085580:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574507.085601:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8a7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8c0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085681:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8a81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085695:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8a81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085707:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8a81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085722:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8a88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085728:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8a88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085734:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8a88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085808:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085817:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085824:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574507.085876:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787574507.085886:0:11515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574507.085922:0:11515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085935:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085945:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8a81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085953:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8a81 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085960:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8a81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085977:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faae00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574507.085983:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8a81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.085999:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8a81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086011:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:2.0:1787574507.086014:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574507.086019:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8a81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086025:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8a81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086042:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8a88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086058:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8a88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086064:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8a88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086069:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574507.086072:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8a88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086078:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8a88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086086:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca52057f100) 00010000:00010000:2.0:1787574507.086089:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574507.086092:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8a88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086097:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8a88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086129:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8a7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8c0 expref: 25 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086145:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8c0 expref: 24 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.086153:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574507.086155:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574507.086165:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab200, rc 0) 00000100:00100000:2.0:1787574507.086234:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:12338:x1874407323682944:12345-192.168.202.40@tcp:101:stat.0 Request processed in 693us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.086304:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 173 00010000:00010000:1.0:1787574507.185508:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574507.215388:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574507.216031:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323683200 00000100:00100000:3.0:1787574507.216044:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323683200 00000100:00100000:3.0:1787574507.216119:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:3.0:1787574507.216131:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:12348:x1874407323683200:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574507.216151:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574507.216177:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8a96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8c7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574507.216321:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787574507.216424:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8a96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8c7 expref: 26 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.216439:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a50d00) 00010000:00010000:3.0:1787574507.216442:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574507.216448:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8a96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8c7 expref: 26 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.216463:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb800, rc 0) 00000100:00100000:3.0:1787574507.216555:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:12348:x1874407323683200:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 425us (1177us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1787574507.216562:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:1.0:1787574507.222077:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574507.222388:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323683456 00000100:00100000:0.0:1787574507.222399:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323683456 00000100:00100000:0.0:1787574507.222458:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:0.0:1787574507.222469:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b65ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:12348:x1874407323683456:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1787574507.222687:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b65ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+26:12348:x1874407323683456:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 219us (619us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1787574507.222696:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:1.0:1787574507.249912:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346826496:0@lo:400:kworker.0 00000100:00100000:1.0:1787574507.250002:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574507.250078:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346827008:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.250374:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346826240:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.250411:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574507.250438:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346826752:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.250524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574507.250545:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346827264:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.250570:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574507.250587:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346827776:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.250607:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574507.250633:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787574507.250640:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346826624:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.250673:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346826240 00000100:00100000:3.0:1787574507.250680:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346826240 00000100:00100000:3.0:1787574507.250728:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1787574507.250737:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346826240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.250798:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346826240:12345-0@lo:400:kworker.0 Request processed in 62us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574507.250805:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1787574507.250837:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346826496 00000100:00100000:3.0:1787574507.250842:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346826496 00000100:00100000:3.0:1787574507.250862:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346826752 00000100:00100000:3.0:1787574507.250865:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346826752 00000100:00100000:3.0:1787574507.250879:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787574507.250885:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346826496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.250929:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346826496:12345-0@lo:400:kworker.0 Request processed in 43us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574507.250935:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787574507.250950:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787574507.250956:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346826752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.250983:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346826752:12345-0@lo:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574507.251004:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787574507.251040:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346826368:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.251416:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346827264 00000100:00100000:3.0:1787574507.251422:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346827264 00000100:00100000:3.0:1787574507.251458:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346827776 00000100:00100000:3.0:1787574507.251461:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346827776 00000100:00100000:3.0:1787574507.251483:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787574507.251491:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346827264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.251534:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346827264:12345-0@lo:400:kworker.0 Request processed in 45us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574507.251541:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787574507.251554:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787574507.251560:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1874407346827776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.251586:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1874407346827776:12345-0@lo:400:kworker.0 Request processed in 26us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574507.251592:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1787574507.251608:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574507.251612:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574507.252320:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574507.252380:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346827520:0@lo:400:kworker.0 00000100:00100000:1.0:1787574507.252417:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574507.252442:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404133100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346828032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574507.252465:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574507.252498:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346826496:0@lo:400:kworker.0 00000100:00100000:1.0:1787574507.252528:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574507.252549:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346826880:0@lo:400:kworker.0 00000100:00100000:1.0:1787574507.252569:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574507.252587:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346827392:0@lo:400:kworker.0 00000100:00100000:1.0:1787574507.252605:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574507.252623:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346827904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574507.252645:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574507.252675:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346827904 00000100:00100000:1.0:1787574507.252681:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346827904 00000100:00100000:1.0:1787574507.252713:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787574507.252720:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346827904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574507.252759:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787574507.252926:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346828032 00000100:00100000:2.0:1787574507.252931:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346828032 00000100:00100000:2.0:1787574507.252970:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787574507.252977:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346828032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574507.253008:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574507.253064:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346828032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.253070:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1787574507.253090:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574507.253112:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346827008 00000100:00100000:2.0:1787574507.253115:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346827008 00000100:00100000:2.0:1787574507.253148:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346827520 00000100:00100000:2.0:1787574507.253152:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346827520 00000100:00100000:2.0:1787574507.253164:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346826368 00000100:00100000:2.0:1787574507.253167:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346826368 00000100:00100000:2.0:1787574507.253178:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346826880 00000100:00100000:2.0:1787574507.253180:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346826880 00000100:00100000:2.0:1787574507.253192:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346827392 00000100:00100000:2.0:1787574507.253194:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346827392 00000100:00100000:2.0:1787574507.253209:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1787574507.253215:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346827008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574507.253277:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346827008:12345-0@lo:400:kworker.0 Request processed in 62us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.253284:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1787574507.253296:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787574507.253310:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346827520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574507.253340:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346827520:12345-0@lo:400:kworker.0 Request processed in 31us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.253346:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787574507.253359:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1787574507.253365:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346826368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574507.253395:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346826368:12345-0@lo:400:kworker.0 Request processed in 30us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.253400:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1787574507.253409:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787574507.253415:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346826880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574507.253435:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346826880:12345-0@lo:400:kworker.0 Request processed in 21us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.253440:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787574507.253449:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1787574507.253454:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346827392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574507.253476:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346827392:12345-0@lo:400:kworker.0 Request processed in 22us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.253481:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00080000:2.0:1787574507.253494:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574507.253497:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574507.254602:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346827904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1877us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574507.254614:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787574507.254672:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346826368:0@lo:400:kworker.0 00000100:00100000:1.0:1787574507.254686:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346826880:0@lo:400:kworker.0 00000100:00100000:1.0:1787574507.254697:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346827392:0@lo:400:kworker.0 00000100:00100000:1.0:1787574507.254714:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346827904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574507.254758:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404133100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346828032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574507.254944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574507.254985:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346827136:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.255029:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574507.255068:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346827648:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.255087:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574507.255120:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346826240:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.255132:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346826752:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.255142:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346827264:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.255153:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346827776:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.255180:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346827136 00000100:00100000:3.0:1787574507.255185:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346827136 00000100:00100000:3.0:1787574507.255226:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346827648 00000100:00100000:3.0:1787574507.255229:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346827648 00000100:00100000:3.0:1787574507.255264:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787574507.255272:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346827136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.255314:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346827136:12345-0@lo:400:kworker.0 Request processed in 43us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574507.255320:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787574507.255334:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787574507.255339:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346827648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.255365:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346827648:12345-0@lo:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574507.255370:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787574507.255399:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346827136:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.255407:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346827648:0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.255449:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346826624 00000100:00100000:3.0:1787574507.255452:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346826624 00000100:00100000:3.0:1787574507.255942:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787574507.255950:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346826624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574507.256004:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346826624:12345-0@lo:400:kworker.0 Request processed in 54us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574507.256010:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787574507.256041:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346826624:0@lo:400:kworker.0 00010000:00080000:1.0:1787574507.256332:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4040a4e00 x1874407346827008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574507.256344:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346827008:0@lo:400:kworker.0 00010000:00080000:1.0:1787574507.256361:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4b3480 x1874407346827520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574507.256368:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346827520:0@lo:400:kworker.0 00000100:00080000:2.0:1787574507.256592:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574507.256928:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346828160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574507.256967:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574507.257327:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346828160 00000100:00100000:2.0:1787574507.257334:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346828160 00000100:00100000:2.0:1787574507.257382:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787574507.257391:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1874407346828160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574507.257425:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574507.257477:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1874407346828160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.257483:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787574507.257597:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346828160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574507.293478:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574507.293527:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574507.293556:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574507.293593:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574507.293616:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574507.293642:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574507.293667:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323683840 00000100:00100000:1.0:1787574507.293686:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323683840 00000100:00100000:1.0:1787574507.293738:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323683968 00000100:00100000:1.0:1787574507.293741:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323683968 00000100:00100000:1.0:1787574507.293765:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 157 00000100:00100000:0.0:1787574507.293881:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323684096 00000100:00100000:0.0:1787574507.293886:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323684096 00000100:00100000:0.0:1787574507.293922:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323683712 00000100:00100000:0.0:1787574507.293925:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323683712 00000100:00100000:0.0:1787574507.293940:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323684224 00000100:00100000:0.0:1787574507.293943:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323684224 00000100:00100000:0.0:1787574507.293955:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 389 00000100:00100000:0.0:1787574507.293963:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323684096:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574507.294048:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323684096:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 85us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574507.294056:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 389 00000100:00100000:0.0:1787574507.294071:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 390 00000100:00100000:0.0:1787574507.294077:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323683712:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574507.294097:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323683712:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574507.294102:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 390 00000100:00100000:0.0:1787574507.294112:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 391 00000100:00100000:0.0:1787574507.294118:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323684224:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574507.294138:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323684224:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574507.294143:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 391 00000100:00100000:1.0:1787574507.294390:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323683840:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574507.294422:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2404:x1874407323683840:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.294480:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323683584 00000100:00100000:2.0:1787574507.294485:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323683584 00000100:00100000:2.0:1787574507.294513:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 402 00000100:00100000:2.0:1787574507.294519:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323683584:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574507.294545:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323683584:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.294550:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 402 00000100:00080000:2.0:1787574507.294578:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574507.294582:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574507.294585:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574507.294587:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574507.301360:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:0.0:1787574507.301390:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323683968:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574507.301480:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323683968:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 106us (7862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574507.301506:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:1.0:1787574507.306508:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 157 00000100:00100000:1.0:1787574507.327433:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574507.327580:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323684480 00000100:00100000:0.0:1787574507.327595:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323684480 00000100:00100000:0.0:1787574507.327711:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:0.0:1787574507.327728:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+26:12354:x1874407323684480:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1787574507.327766:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574507.327797:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aa4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.328358:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.328380:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8c0 expref: 27 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.328390:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.328439:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8c0 expref: 27 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.328456:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8c0 expref: 27 pid: 11515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574507.328473:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346828288:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574507.328592:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787574507.334658:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346828288:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574507.334716:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574507.338104:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574507.338226:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323684608 00000100:00100000:0.0:1787574507.338294:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323684608 00010000:00010000:0.0:1787574507.338351:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8c0 expref: 28 pid: 11515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574507.338401:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:0.0:1787574507.338412:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+28:2405:x1874407323684608:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574507.338431:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574507.338438:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8c0 expref: 28 pid: 11515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.338454:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8c0 expref: 28 pid: 11515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.338481:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8a8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8c0 expref: 28 pid: 11515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.338504:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574507.338510:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.338522:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.340803:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.340879:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574507.341291:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:2405:x1874407323684608:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 2871us (3192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574507.341324:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00010000:00010000:3.0:1787574507.342287:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.342304:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574507.342333:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787574507.342540:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aa4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ce expref: 28 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.342565:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ce expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.342576:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:3.0:1787574507.342580:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574507.342595:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031a00, rc 0) 00000100:00100000:3.0:1787574507.342673:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:12354:x1874407323684480:12345-192.168.202.40@tcp:101:bash.0 Request processed in 14949us (15257us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787574507.342692:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:1.0:1787574507.348223:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574507.348404:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323684864 00000100:00100000:0.0:1787574507.348419:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323684864 00000100:00100000:0.0:1787574507.348501:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 176 00000100:00100000:0.0:1787574507.348514:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:12354:x1874407323684864:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:0.0:1787574507.349149:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.349176:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.349190:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574507.349380:0:8610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1787574507.349408:0:8610:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed4fa9e7 reply state 000000004325c50a transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.349424:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.349433:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574507.349437:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574507.349442:0:8610:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574507.350172:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:12354:x1874407323684864:12345-192.168.202.40@tcp:36:bash.0 Request processed in 1654us (1960us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1787574507.350184:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 176 00000020:00080000:0.0:1787574507.350191:0:8610:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787574507.370040:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574507.370703:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323684992 00000100:00100000:3.0:1787574507.370721:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323684992 00000100:00100000:3.0:1787574507.370805:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:3.0:1787574507.370820:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:12354:x1874407323684992:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1787574507.370855:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574507.370882:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8ac0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.371494:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8ac7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.371517:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ce expref: 31 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.371540:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8ac7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.371585:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ce expref: 31 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.371602:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ce expref: 31 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574507.371620:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346828416:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574507.372331:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574507.382973:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346828416:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574507.383028:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8ac7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574507.384451:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574507.388377:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323685120 00000100:00100000:2.0:1787574507.388399:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323685120 00010000:00010000:2.0:1787574507.388476:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ce expref: 32 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574507.388575:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:2.0:1787574507.388588:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:2405:x1874407323685120:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574507.388609:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574507.388617:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ce expref: 32 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.388644:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ce expref: 32 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.388672:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8aab lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ce expref: 32 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.388849:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574507.388856:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8ac7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.388868:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.388877:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8ac7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.389196:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574507.389345:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+31:2405:x1874407323685120:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 758us (4902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.389355:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 85 00010000:00010000:3.0:1787574507.391816:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.391839:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574507.392096:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787574507.392123:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574507.392157:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.392209:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8ac0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8d5 expref: 31 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.392236:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8d5 expref: 30 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.392268:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574507.392271:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574507.392274:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa000, rc 0) 00000100:00100000:2.0:1787574507.392372:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:12354:x1874407323684992:12345-192.168.202.40@tcp:101:bash.0 Request processed in 21554us (22346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574507.392382:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:0.0:1787574507.398605:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574507.399166:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323685376 00000100:00100000:2.0:1787574507.399181:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323685376 00000100:00100000:2.0:1787574507.399299:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:2.0:1787574507.399312:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:12354:x1874407323685376:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:2.0:1787574507.400149:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+31:12354:x1874407323685376:12345-192.168.202.40@tcp:35:bash.0 Request processed in 836us (1630us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787574507.400160:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:0.0:1787574507.578387:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574507.578539:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323685632 00000100:00100000:3.0:1787574507.578554:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323685632 00000100:00100000:3.0:1787574507.578649:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:3.0:1787574507.578663:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+31:12364:x1874407323685632:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574507.579128:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574507.579159:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8ace lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8dc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574507.579311:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787574507.581161:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8ace lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8dc expref: 33 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.581189:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a50d00) 00010000:00010000:3.0:1787574507.581193:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574507.581199:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8ace lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8dc expref: 33 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.581218:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa200, rc 0) 00000100:00100000:3.0:1787574507.581439:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:12364:x1874407323685632:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2776us (3407us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1787574507.581451:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:1.0:1787574507.593501:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574507.593623:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323685760 00000100:00100000:0.0:1787574507.593891:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323685760 00000100:00100000:0.0:1787574507.594076:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:0.0:1787574507.594093:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:12364:x1874407323685760:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1787574507.594210:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8adc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594234:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8adc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594305:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8adc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594328:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8ae3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594335:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594343:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594443:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594453:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594482:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574507.594548:0:8610:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594565:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8adc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594572:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8adc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594580:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8adc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594586:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574507.594591:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8adc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594599:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8adc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594613:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:0.0:1787574507.594617:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574507.594623:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8adc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.594629:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8adc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.596884:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.596915:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8ae3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597290:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597299:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574507.597304:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597313:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8ae3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597332:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca534a50f00) 00010000:00010000:0.0:1787574507.597336:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574507.597340:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8ae3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597347:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8ae3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597368:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597374:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597380:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597385:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574507.597394:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597401:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597409:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574507.597412:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574507.597415:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aea lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.597421:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8aea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574507.597639:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:12364:x1874407323685760:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 3534us (4137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574507.597651:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:1.0:1787574507.608078:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574507.608321:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323686016 00000100:00100000:3.0:1787574507.608353:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323686016 00000100:00100000:3.0:1787574507.608427:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:3.0:1787574507.608440:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:12364:x1874407323686016:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1787574507.608764:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+33:12364:x1874407323686016:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 324us (700us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787574507.608774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:1.0:1787574507.682207:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574507.682411:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323686272 00000100:00100000:2.0:1787574507.682425:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323686272 00000100:00100000:2.0:1787574507.682503:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00100000:2.0:1787574507.682516:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+33:12367:x1874407323686272:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574507.682547:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574507.682593:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8af1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.682715:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8af8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.682734:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8af8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.682748:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8af8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.682766:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8aff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.682774:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8aff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.682781:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8aff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.682926:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8b06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.682938:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8b06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.682945:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8b06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574507.682958:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787574507.683082:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8af8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683120:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8af8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683128:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8af8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683134:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574507.683140:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8af8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683148:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8af8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683162:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:2.0:1787574507.683174:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574507.683180:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8af8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683186:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8af8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683205:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8aff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683211:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8aff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683217:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8aff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683223:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faae00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574507.683232:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8aff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683290:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8aff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683301:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca52057f100) 00010000:00010000:2.0:1787574507.683303:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574507.683306:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8aff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683313:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8aff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683368:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8af1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8e3 expref: 36 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683388:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8b06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8e3 expref: 35 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574507.683397:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574507.683400:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574507.683402:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab200, rc 0) 00000100:00100000:2.0:1787574507.683481:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:12367:x1874407323686272:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 967us (1289us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787574507.683490:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00100000:2.0:1787574507.702323:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574507.702456:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574507.705910:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323686528 00000100:00100000:1.0:1787574507.705932:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323686528 00000100:00100000:1.0:1787574507.706062:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:1.0:1787574507.706076:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:2403:x1874407323686528:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574507.706100:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574507.706135:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8b06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8e3 expref: 35 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574507.706165:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:1.0:1787574507.706170:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574507.706327:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:2403:x1874407323686528:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 254us (3870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574507.706336:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:3.0:1787574507.707870:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323686400 00000100:00100000:3.0:1787574507.707884:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323686400 00000100:00100000:3.0:1787574507.707967:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 181 00000100:00100000:3.0:1787574507.707979:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:12367:x1874407323686400:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1787574507.708076:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.708095:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.708109:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.708155:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.708163:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.708171:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.708177:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574507.708182:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.708206:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.708222:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:3.0:1787574507.708225:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574507.708230:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574507.708579:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574507.708771:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:12367:x1874407323686400:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 792us (6462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574507.708781:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 181 00000100:00100000:0.0:1787574507.718342:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574507.718609:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323686784 00000100:00100000:3.0:1787574507.718624:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323686784 00000100:00100000:3.0:1787574507.718712:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:3.0:1787574507.718726:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:12367:x1874407323686784:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1787574507.719064:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:12367:x1874407323686784:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 340us (736us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787574507.719074:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:1.0:1787574507.977766:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574507.977972:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323687040 00000100:00100000:0.0:1787574507.977998:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323687040 00000100:00100000:0.0:1787574507.978350:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:0.0:1787574507.978366:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:12385:x1874407323687040:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1787574507.978402:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574507.978430:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8ea expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.978594:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8b22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.978612:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8b22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.978642:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8b22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574507.978658:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787574507.978946:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ea expref: 38 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.978971:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8b22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ea expref: 37 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574507.978993:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574507.978997:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787574507.979000:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031a00, rc 0) 00000100:00100000:0.0:1787574507.979463:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12385:x1874407323687040:12345-192.168.202.40@tcp:101:cat.0 Request processed in 1098us (1766us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787574507.979473:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:1.0:1787574508.032878:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.033386:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323687168 00000100:00100000:0.0:1787574508.033401:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323687168 00000100:00080000:2.0:1787574508.035193:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574508.035307:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 183 00000100:00100000:0.0:1787574508.035343:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12386:x1874407323687168:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574508.035379:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574508.035414:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8f1 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.035516:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8b37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.035704:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.035719:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574508.035780:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787574508.035784:0:11515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574508.035809:0:11515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.037564:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f1 expref: 39 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.037605:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8b37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f1 expref: 38 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.037616:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:0.0:1787574508.037619:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574508.037624:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031600, rc 0) 00000100:00100000:0.0:1787574508.037748:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:12386:x1874407323687168:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2427us (4883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574508.037759:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 183 00000100:00100000:3.0:1787574508.048812:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.048949:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323687552 00000100:00100000:0.0:1787574508.048962:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323687552 00000100:00100000:0.0:1787574508.049053:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1787574508.049066:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:12386:x1874407323687552:12345-192.168.202.40@tcp:35:lfs.0 00000001:00080000:0.0:1787574508.049415:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967458 00000100:00100000:0.0:1787574508.051126:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12386:x1874407323687552:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 2048us (2314us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787574508.051143:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000020:00080000:0.0:1787574508.051150:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787574508.054340:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.054722:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323687680 00000100:00100000:0.0:1787574508.054735:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323687680 00000100:00100000:0.0:1787574508.055067:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1787574508.055081:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12386:x1874407323687680:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:0.0:1787574508.055103:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787574508.055139:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8ac7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8d5 expref: 40 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.055170:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8b22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ea expref: 39 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.055186:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb89bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b88f expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.055197:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574508.055203:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574508.055331:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12386:x1874407323687680:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 253us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574508.055340:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1787574508.057593:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574508.057782:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323687808 00000100:00100000:3.0:1787574508.057793:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323687808 00000100:00100000:3.0:1787574508.057881:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:3.0:1787574508.057895:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12386:x1874407323687808:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:3.0:1787574508.058100:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.058122:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.058135:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574508.058298:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787574508.058397:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12386:x1874407323687808:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 504us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574508.058406:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:3.0:1787574508.073599:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.073739:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323687936 00000100:00100000:0.0:1787574508.073753:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323687936 00000100:00100000:0.0:1787574508.073824:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 185 00000100:00100000:0.0:1787574508.073912:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12388:x1874407323687936:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574508.073974:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574508.074012:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8b45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8f8 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.074102:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b4c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.074120:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.074134:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.074175:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d800/0xd18a1efeeddb8b53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.074184:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d800/0xd18a1efeeddb8b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.074191:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d800/0xd18a1efeeddb8b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.074326:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.074336:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.074343:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574508.074396:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787574508.074408:0:8610:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574508.075209:0:8610:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075231:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075275:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075284:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b4c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075292:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075299:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574508.075305:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075314:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b4c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075331:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:0.0:1787574508.075335:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574508.075340:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075346:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb8b4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075365:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d800/0xd18a1efeeddb8b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075387:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d800/0xd18a1efeeddb8b53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075392:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d800/0xd18a1efeeddb8b53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075397:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574508.075400:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d800/0xd18a1efeeddb8b53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075407:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d800/0xd18a1efeeddb8b53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075416:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca534a50f00) 00010000:00010000:0.0:1787574508.075419:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574508.075422:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d800/0xd18a1efeeddb8b53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075428:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d800/0xd18a1efeeddb8b53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075639:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb8b45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f8 expref: 39 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075657:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f8 expref: 38 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.075665:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574508.075668:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574508.075679:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c600, rc 0) 00000100:00100000:1.0:1787574508.076058:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:12388:x1874407323687936:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2147us (2473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574508.076069:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 185 00010000:00010000:0.0:1787574508.209344:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574508.274631:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787574508.274651:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787574508.274702:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787574508.274712:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787574508.274911:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346828544:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787574508.276066:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574508.285647:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.287086:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323688064 00000100:00100000:0.0:1787574508.287103:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323688064 00000100:00100000:0.0:1787574508.287188:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:0.0:1787574508.287201:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:12399:x1874407323688064:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787574508.287265:0:11515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787574508.287653:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:12399:x1874407323688064:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 453us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574508.287663:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:1.0:1787574508.291291:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346828544:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787574508.300580:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574508.302276:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323688192 00000100:00100000:1.0:1787574508.302401:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323688192 00000100:00100000:1.0:1787574508.302597:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00100000:1.0:1787574508.302609:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:12399:x1874407323688192:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787574508.303222:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8b61 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.303281:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8b61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304006:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8b61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304041:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8b68 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304050:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8b68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304059:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8b68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304096:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8b6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304126:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8b6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304493:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8b6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574508.304562:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787574508.304567:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574508.304584:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8b6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304598:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8b61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304605:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8b61 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304613:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8b61 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304815:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574508.304823:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8b61 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304834:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8b61 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304850:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:1.0:1787574508.304853:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574508.304858:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8b61 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.304878:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8b61 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305015:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8b68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305025:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8b68 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305031:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8b68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305037:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574508.305041:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8b68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305048:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8b68 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305057:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9ca535d9de00) 00010000:00010000:1.0:1787574508.305060:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574508.305063:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8b68 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305069:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8b68 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305091:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8b6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305099:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8b6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305111:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8b6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305117:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574508.305120:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8b6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305127:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8b6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305871:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:1.0:1787574508.305880:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574508.305884:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8b6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.305902:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8b6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574508.306911:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:12399:x1874407323688192:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 4284us (6326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574508.306933:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00100000:3.0:1787574508.313587:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574508.313822:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323688448 00000100:00100000:1.0:1787574508.313835:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323688448 00000100:00100000:1.0:1787574508.313918:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:1.0:1787574508.313938:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:12399:x1874407323688448:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574508.313965:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574508.314001:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb8b76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b8ff expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314167:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8b7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314187:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8b7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314200:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8b7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574508.314213:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787574508.314367:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8b7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314376:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8b7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314384:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8b7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314391:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574508.314398:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8b7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314406:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8b7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314420:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:1.0:1787574508.314423:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787574508.314429:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8b7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314446:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8b7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314503:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb8b76 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ff expref: 40 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314513:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:1.0:1787574508.314516:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574508.314522:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb8b76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8ff expref: 40 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.314533:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19200, rc 0) 00000100:00100000:1.0:1787574508.314618:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:12399:x1874407323688448:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 690us (1051us total) trans 4294967460 rc 301/301 00000100:00100000:1.0:1787574508.314637:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:3.0:1787574508.319717:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.319935:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323688576 00000100:00100000:0.0:1787574508.319950:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323688576 00000100:00100000:3.0:1787574508.320172:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:3.0:1787574508.320188:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:12399:x1874407323688576:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787574508.320279:0:6511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787574508.320658:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:12399:x1874407323688576:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 473us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574508.320666:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:0.0:1787574508.337815:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574508.338834:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323688832 00000100:00100000:1.0:1787574508.338849:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323688832 00000100:00100000:0.0:1787574508.339959:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:0.0:1787574508.339989:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:12399:x1874407323688832:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574508.340017:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574508.340021:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787574508.340065:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb8b37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f1 expref: 39 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.340087:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:0.0:1787574508.340093:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574508.340110:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8b8b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b906 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787574508.340716:0:6509:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787574508.340891:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8b92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.340915:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.340928:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.341006:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8b8b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b906 expref: 41 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.341025:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8b92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b906 expref: 40 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.341035:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca534a50f00) 00010000:00010000:0.0:1787574508.341038:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574508.341042:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d000, rc 0) 00000100:00100000:0.0:1787574508.341137:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12399:x1874407323688832:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1166us (3338us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787574508.341146:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:1.0:1787574508.354126:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574508.354413:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323689088 00000100:00100000:3.0:1787574508.354427:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323689088 00000100:00100000:3.0:1787574508.354499:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00100000:3.0:1787574508.354512:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12399:x1874407323689088:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787574508.354605:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574508.354652:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8b92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b906 expref: 40 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.354677:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca534a50f00) 00010000:00010000:3.0:1787574508.354690:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574508.354718:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8ba0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.354735:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8ba0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.354746:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8ba0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.359916:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8ba7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xa141468f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.359939:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa141468f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.359951:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa141468f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360011:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8ba0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360019:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8ba0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360026:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8ba0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360046:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fbe00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574508.360051:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8ba0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360058:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8ba0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360072:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574508.360075:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574508.360079:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8ba0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360084:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8ba0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360100:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa141468f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360106:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8ba7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa141468f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360112:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8ba7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa141468f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360118:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574508.360121:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8ba7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa141468f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360127:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8ba7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa141468f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360144:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xa141468f (ffff9ca5186cad00) 00010000:00010000:3.0:1787574508.360146:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574508.360149:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8ba7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa141468f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.360154:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8ba7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa141468f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574508.360286:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:12399:x1874407323689088:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 5771us (6170us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574508.360296:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00100000:1.0:1787574508.368030:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574508.368136:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323689216 00000100:00100000:3.0:1787574508.368148:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323689216 00000100:00100000:3.0:1787574508.368215:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:3.0:1787574508.368227:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:12399:x1874407323689216:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574508.368267:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574508.368290:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8bae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b90d expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.368324:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8bb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.368337:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.368348:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.368466:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8bae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b90d expref: 41 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.368492:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b90d expref: 40 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.368501:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:3.0:1787574508.368504:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787574508.368508:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb800, rc 0) 00000100:00100000:3.0:1787574508.368566:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12399:x1874407323689216:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 341us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574508.368573:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:3.0:1787574508.371872:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574508.377801:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323689472 00000100:00100000:1.0:1787574508.377817:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323689472 00000100:00100000:1.0:1787574508.378046:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:1.0:1787574508.378060:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12399:x1874407323689472:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787574508.378155:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.378174:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.378201:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574508.378416:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787574508.378428:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 447561187002ns, next at 448561184331ns, rc = 0 00000004:00010000:1.0:1787574508.378477:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000871800bd reply state 000000007f1615aa transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.378492:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.378501:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:1.0:1787574508.378504:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787574508.378508:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787574508.378613:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+42:12399:x1874407323689472:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 556us (6752us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1787574508.378633:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:1.0:1787574508.388916:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.388999:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323689600 00000100:00100000:0.0:1787574508.389010:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323689600 00000100:00100000:0.0:1787574508.389797:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:0.0:1787574508.389809:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+42:12399:x1874407323689600:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574508.389829:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574508.389848:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8bc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b914 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.389895:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b914 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.389913:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b914 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.389928:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:0.0:1787574508.389930:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574508.389933:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d400, rc 0) 00000100:00100000:0.0:1787574508.390022:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:12399:x1874407323689600:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 215us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574508.390030:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:3.0:1787574508.406274:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.406488:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323689728 00000100:00100000:0.0:1787574508.406496:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323689728 00000100:00100000:0.0:1787574508.406546:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:0.0:1787574508.406553:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+6:2402:x1874407323689728:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787574508.406761:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2402:x1874407323689728:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 207us (497us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787574508.406766:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1787574508.409565:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.409615:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323689984 00000100:00100000:2.0:1787574508.409623:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323689984 00000100:00100000:2.0:1787574508.409662:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:2.0:1787574508.409669:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:12399:x1874407323689984:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787574508.409835:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+44:12399:x1874407323689984:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 166us (277us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1787574508.409841:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:0.0:1787574508.418173:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574508.418529:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323690240 00000100:00100000:1.0:1787574508.418538:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323690240 00000100:00100000:1.0:1787574508.418582:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:1.0:1787574508.418590:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+44:12399:x1874407323690240:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787574508.418691:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+44:12399:x1874407323690240:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 102us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574508.418697:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:3.0:1787574508.424585:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574508.424681:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323690368 00000100:00100000:1.0:1787574508.424691:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323690368 00000100:00100000:1.0:1787574508.424777:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:1.0:1787574508.424787:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+44:12399:x1874407323690368:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574508.424807:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574508.424827:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8bca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b91b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.424911:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8bd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.424926:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.424938:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574508.424992:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574508.425011:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.425039:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8bca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b91b expref: 46 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.425056:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b91b expref: 45 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.425064:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:1.0:1787574508.425067:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787574508.425071:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e18400, rc 0) 00000100:00100000:1.0:1787574508.425128:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+45:12399:x1874407323690368:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 343us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574508.425144:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:3.0:1787574508.428188:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.428283:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323690496 00000100:00100000:2.0:1787574508.428293:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323690496 00000100:00100000:2.0:1787574508.428346:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:2.0:1787574508.428356:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323690496:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574508.428375:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574508.428391:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8bd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b922 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574508.428416:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c38eb, blocks: 0x0 00010000:00010000:2.0:1787574508.428434:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1787574508.428439:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574508.428448:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8bd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b922 expref: 8 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.428476:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8bd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b922 expref: 8 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.428487:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fabe00, rc 0) 00000100:00100000:2.0:1787574508.428532:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323690496:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 179us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574508.428538:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:0.0:1787574508.439191:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.439276:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323690752 00000100:00100000:2.0:1787574508.439284:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323690752 00000100:00100000:2.0:1787574508.439332:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00100000:2.0:1787574508.439340:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+45:12399:x1874407323690752:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787574508.439436:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+45:12399:x1874407323690752:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574508.439444:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00100000:3.0:1787574508.442373:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574508.442452:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323690880 00000100:00100000:1.0:1787574508.442466:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323690880 00000100:00100000:1.0:1787574508.442531:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:1.0:1787574508.442542:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:12399:x1874407323690880:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574508.442560:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574508.442584:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b929 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.442619:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8bd8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b922 expref: 9 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.442628:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574508.442633:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574508.442638:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.442676:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8bd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b922 expref: 9 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.442690:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8bd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b922 expref: 9 pid: 8425 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574508.442704:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1874407346828672:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574508.442818:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574508.452442:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1874407346828672:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574508.452480:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.452501:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19400, rc 0) 00000100:00100000:1.0:1787574508.452569:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:12399:x1874407323690880:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 10029us (10212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574508.452579:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:3.0:1787574508.454353:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574508.455095:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323691008 00000100:00100000:1.0:1787574508.455107:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323691008 00010000:00010000:1.0:1787574508.455145:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8bd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b922 expref: 9 pid: 8425 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574508.455188:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:1.0:1787574508.455194:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2404:x1874407323691008:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574508.455206:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574508.455222:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8bd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b922 expref: 9 pid: 8425 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.455233:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8bd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b922 expref: 9 pid: 8425 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.455263:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8bd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b922 expref: 9 pid: 8425 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.455277:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574508.455286:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574508.455292:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.455299:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.455327:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574508.455336:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6496:1874407346828800:192.168.202.40@tcp:105: 00000100:00100000:1.0:1787574508.455404:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787574508.465646:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6496:1874407346828800:192.168.202.40@tcp:105: 00010000:00010000:1.0:1787574508.465672:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574508.465722:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323691008:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 10525us (11384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574508.465734:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:3.0:1787574508.467368:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574508.467456:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323691136 00000100:00100000:1.0:1787574508.467463:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323691136 00002000:00100000:1.0:1787574508.467504:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9ca404388700 x1874407323691136/t0(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:279/0 lens 504/0 e 0 to 0 dl 1787574519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787574508.467512:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404388700 with x1874407323691136 ext(0->8) 00002000:00010000:1.0:1787574508.467516:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca404388700 00000100:00100000:1.0:1787574508.467570:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1787574508.467579:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323691136:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787574508.468637:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:2404:x1874407323691136:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 1053us (1268us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787574508.468647:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00002000:00100000:1.0:1787574508.468655:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9ca404388700 x1874407323691136/t4294967315(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:279/0 lens 504/448 e 0 to 0 dl 1787574519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787574508.468663:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404388700 with x1874407323691136 ext(0->8) 00002000:00010000:1.0:1787574508.468667:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca404388700 00000100:00100000:2.0:1787574508.476366:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.476404:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323691264 00000100:00100000:2.0:1787574508.476416:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323691264 00000100:00100000:2.0:1787574508.476467:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 198 00000100:00100000:2.0:1787574508.476477:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+45:12399:x1874407323691264:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787574508.480944:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:0.0:1787574508.480960:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787574508.481016:0:6488:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1787574508.481042:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1787574508.481045:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481059:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481077:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481084:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030c00 already unused, calling callback (ffffffffc18d74f0) 00000020:00080000:0.0:1787574508.481087:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1787574508.481090:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481099:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481117:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574508.481120:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574508.481125:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481132:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030c00/0xd18a1efeeddb8a50 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481150:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481156:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481161:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481166:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574508.481170:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481185:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481195:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574508.481197:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574508.481200:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481206:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8a73 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481220:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481226:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481232:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481236:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574508.481259:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481266:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481274:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574508.481276:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574508.481278:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481293:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb8ab9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481307:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481312:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481318:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481322:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574508.481325:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481332:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481340:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:2.0:1787574508.481343:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787574508.481346:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.481352:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8bbc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.481504:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:12399:x1874407323691264:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 5022us (5140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574508.481516:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 198 00000100:00100000:0.0:1787574508.481742:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346828928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787574508.481793:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574508.481836:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346828928 00000100:00100000:2.0:1787574508.481845:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346828928 00000100:00100000:2.0:1787574508.481892:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787574508.481902:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346828928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787574508.482104:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787574508.482108:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787574508 00002000:00010000:2.0:1787574508.482111:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787574508.482113:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787574507 -> 1787574508 00002000:00010000:2.0:1787574508.482115:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787574508.482159:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346828928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 258us (365us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787574508.482165:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1787574508.482306:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca40438aa00/2, rc 0, transno 4294967316 00000100:00100000:0.0:1787574508.482314:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346828928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787574508.484344:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574508.484752:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323691392 00000100:00100000:3.0:1787574508.484762:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323691392 00000100:00100000:3.0:1787574508.484811:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:3.0:1787574508.484822:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:2405:x1874407323691392:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787574508.493343:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1787574508.493354:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1787574508.493497:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323691392:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 8669us (9155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574508.493509:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:0.0:1787574508.500097:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574508.500178:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323691648 00000100:00100000:3.0:1787574508.500188:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323691648 00000100:00100000:2.0:1787574508.500325:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:2.0:1787574508.500335:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:12399:x1874407323691648:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787574508.500382:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574508.500407:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8bd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b91b expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.500425:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:2.0:1787574508.500430:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574508.500459:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.500469:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.500475:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787574508.500583:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1c0bfbd reply state 00000000c732033c transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.500592:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.500596:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:2.0:1787574508.500598:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787574508.500600:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574508.500698:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:12399:x1874407323691648:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 365us (612us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1787574508.500704:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:3.0:1787574508.502746:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.506268:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323691776 00000100:00100000:0.0:1787574508.506284:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323691776 00000100:00100000:0.0:1787574508.506360:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:0.0:1787574508.506369:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323691776:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787574508.506525:0:8619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787574508.506529:0:8619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787574508 -> 1787574507 00002000:00010000:0.0:1787574508.506532:0:8619:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787574504 00002000:00010000:0.0:1787574508.506535:0:8619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787574508 -> 1787574507 00002000:00010000:0.0:1787574508.506537:0:8619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787574508.506609:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323691776:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 239us (3868us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787574508.506617:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:0.0:1787574508.513218:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.513282:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323692032 00000100:00100000:0.0:1787574508.513291:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323692032 00000100:00100000:0.0:1787574508.513351:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 200 00000100:00100000:0.0:1787574508.513362:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5050fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:12399:x1874407323692032:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787574508.513425:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.513458:0:8610:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b90d expref: 20 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.513468:0:8610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.513504:0:8610:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b90d expref: 20 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.513519:0:8610:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b90d expref: 20 pid: 11515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574508.513536:0:8610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5050fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8610:1874407346829056:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574508.513612:0:8610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4033ead80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574508.516626:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574508.516671:0:8610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5050fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8610:1874407346829056:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574508.516695:0:8610:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.517392:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323692160 00000100:00100000:2.0:1787574508.517401:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323692160 00010000:00010000:2.0:1787574508.517435:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b90d expref: 21 pid: 11515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.517468:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:2.0:1787574508.517475:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b689050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:2404:x1874407323692160:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574508.517487:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574508.517492:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b90d expref: 21 pid: 11515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.517501:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b90d expref: 21 pid: 11515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.517518:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8bb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b90d expref: 21 pid: 11515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.517543:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:2.0:1787574508.517547:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.517555:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.517560:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.517588:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574508.517637:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b689050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:2404:x1874407323692160:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 163us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574508.517642:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 87 00010000:00010000:0.0:1787574508.517827:0:8610:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.517833:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.517865:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.517869:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.517873:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.517885:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409ce00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574508.517893:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.517899:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.517906:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:0.0:1787574508.517908:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787574508.517910:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.517914:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8bed lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574508.517963:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5050fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:12399:x1874407323692032:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 4603us (4762us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787574508.517971:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 200 00000100:00100000:3.0:1787574508.520930:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.521058:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323692288 00000100:00100000:2.0:1787574508.521067:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323692288 00000100:00100000:2.0:1787574508.521110:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:2.0:1787574508.521117:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2403:x1874407323692288:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787574508.521152:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.521167:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.521173:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574508.521176:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574508.521179:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.521219:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.521229:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 8 pid: 8426 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.521262:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1874407346829184:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574508.521322:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574508.523092:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1874407346829184:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574508.523115:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574508.527272:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.527363:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323692416 00000100:00100000:2.0:1787574508.527373:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323692416 00010000:00010000:2.0:1787574508.527420:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 9 pid: 8426 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.527465:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:2.0:1787574508.527475:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2405:x1874407323692416:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574508.527489:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574508.527511:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 9 pid: 8426 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527524:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 9 pid: 8426 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527560:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb8bdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b929 expref: 9 pid: 8426 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527576:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574508.527581:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574508.527586:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527595:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527629:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574508.527675:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323692416:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 201us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574508.527683:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00010000:00010000:2.0:1787574508.527714:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527723:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527742:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527749:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527762:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527769:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574508.527774:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527781:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527792:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.527798:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea09ec5b/0xd18a1efeeddb8bf4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.527845:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2403:x1874407323692288:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 6727us (6921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574508.527852:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:3.0:1787574508.532399:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.532482:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323692672 00000100:00100000:2.0:1787574508.532492:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323692672 00000100:00100000:2.0:1787574508.532550:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 201 00000100:00100000:2.0:1787574508.532561:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:12399:x1874407323692672:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787574508.532651:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.532674:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8a49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b2 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.532684:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.532719:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8a49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b2 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.532734:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8a49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b2 expref: 19 pid: 6511 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.532751:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346829312:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574508.532835:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574508.535208:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346829312:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574508.535260:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.536459:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.536548:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323692800 00000100:00100000:0.0:1787574508.536557:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323692800 00010000:00010000:0.0:1787574508.536594:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8a49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b2 expref: 20 pid: 6511 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574508.536632:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:0.0:1787574508.536641:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:2404:x1874407323692800:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574508.536655:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574508.536663:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8a49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b2 expref: 20 pid: 6511 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.536690:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8a49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b2 expref: 20 pid: 6511 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.536710:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb8a49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8b2 expref: 20 pid: 6511 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.536724:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574508.536729:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.536738:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.536746:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.536771:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574508.536803:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.536810:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574508.536818:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:2404:x1874407323692800:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 177us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574508.536826:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00010000:00010000:2.0:1787574508.536992:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.537010:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8bc3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b914 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.537015:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.537036:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b914 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.537044:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8bc3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b914 expref: 19 pid: 6510 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.537054:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346829440:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574508.537105:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574508.539500:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346829440:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574508.539528:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.541387:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574508.541436:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323692928 00000100:00100000:0.0:1787574508.541445:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323692928 00010000:00010000:0.0:1787574508.541481:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8bc3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b914 expref: 20 pid: 6510 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574508.541519:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:0.0:1787574508.541529:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:2404:x1874407323692928:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574508.541550:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574508.541557:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8bc3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b914 expref: 20 pid: 6510 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.541570:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b914 expref: 20 pid: 6510 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.541591:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8bc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b914 expref: 20 pid: 6510 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.541605:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:0.0:1787574508.541610:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.541620:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.541628:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.541658:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574508.541701:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:2404:x1874407323692928:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 174us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574508.541709:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 90 00010000:00010000:2.0:1787574508.541783:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.541792:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574508.541905:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1787574508.542030:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:2.0:1787574508.542065:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1787574508.542148:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6509:1874407346829568:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787574508.542192:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574508.542231:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebe840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574508.542379:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346829568 00000100:00100000:3.0:1787574508.542386:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346829568 00000100:00100000:3.0:1787574508.542417:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787574508.542424:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6509:x1874407346829568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787574508.542522:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6509:x1874407346829568:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574508.542529:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787574508.542581:0:6509:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1787574508.542586:0:6509:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca40438aa00, transno 4294967316 00000100:00100000:0.0:1787574508.542608:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6509:1874407346829568:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787574508.542702:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:0.0:1787574508.542748:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5050fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6509:1874407346829696:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787574508.542778:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574508.542803:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574508.542840:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346829696 00000100:00100000:2.0:1787574508.542851:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346829696 00000100:00100000:2.0:1787574508.542889:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787574508.542896:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6509:x1874407346829696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787574508.543011:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6509:x1874407346829696:12345-0@lo:1000:mdt00_000.0 Request processed in 114us (230us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787574508.543018:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787574508.543516:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5050fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6509:1874407346829696:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787574508.543551:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543560:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543568:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543582:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574508.543587:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543594:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543610:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:3.0:1787574508.543614:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574508.543618:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543625:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c02 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543648:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543654:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b3e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543660:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543666:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574508.543669:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543675:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b3e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543693:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:3.0:1787574508.543695:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574508.543699:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b3e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543705:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8b3e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543727:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543739:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f8 expref: 22 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543748:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543773:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f8 expref: 22 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.543788:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f8 expref: 22 pid: 8610 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574508.543801:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346829824:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574508.543967:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574508.547201:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1874407346829824:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574508.547212:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1787574508.547233:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.548281:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323693056 00000100:00100000:2.0:1787574508.548290:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323693056 00010000:00010000:2.0:1787574508.548322:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f8 expref: 23 pid: 8610 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.548349:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:2.0:1787574508.548356:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:2404:x1874407323693056:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574508.548366:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574508.548372:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f8 expref: 23 pid: 8610 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.548381:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f8 expref: 23 pid: 8610 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.548398:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8b5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b8f8 expref: 23 pid: 8610 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.548408:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574508.548412:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.548420:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.548431:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.548495:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574508.548519:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548530:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548542:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.548547:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:2404:x1874407323693056:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 189us (1338us total) trans 0 rc 0/0 00010000:00010000:3.0:1787574508.548556:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.548558:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 91 00010000:00010000:3.0:1787574508.548567:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548574:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421faa00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574508.548579:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548586:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548595:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:3.0:1787574508.548598:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574508.548602:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548609:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c09 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548621:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548633:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548640:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548645:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574508.548649:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548655:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548664:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:3.0:1787574508.548666:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787574508.548670:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.548676:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8bfb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574508.548856:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:12399:x1874407323692672:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 16296us (16466us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787574508.548864:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 201 00000020:00080000:3.0:1787574508.548868:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787574508.550552:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574508.550560:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574508.551341:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787574508.551351:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787574508.551547:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574508.551604:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323693312 00000100:00100000:3.0:1787574508.551618:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323693312 00000100:00100000:3.0:1787574508.551691:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:3.0:1787574508.551701:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b658050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:12399:x1874407323693312:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787574508.551921:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787574508.551948:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1787574508.551988:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8c10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.552005:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8c10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.552016:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8c10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.552025:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8c10 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.552033:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8c10 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.552039:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8c10 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.552055:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787574508.552125:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b658050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:12399:x1874407323693312:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 425us (582us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787574508.552133:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000020:00080000:3.0:1787574508.552137:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787574508.553281:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574508.553290:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8c10 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.553298:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574508.553303:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8c10 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.553311:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8c10 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.553326:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:2.0:1787574508.553329:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787574508.553333:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8c10 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.553339:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8c10 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.553352:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574508.553353:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574508.553355:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574508.676560:0:14655:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787574508.676570:0:14655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787574508.676607:0:14655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787574508.676614:0:14655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787574508.780113:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.780323:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323693568 00000100:00100000:2.0:1787574508.780334:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323693568 00000100:00100000:2.0:1787574508.780388:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 202 00000100:00100000:2.0:1787574508.780397:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:12409:x1874407323693568:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574508.780417:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574508.780434:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b930 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.780515:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c1e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.780528:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.780537:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574508.780544:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787574508.780621:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b930 expref: 26 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.780636:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b930 expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.780645:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:2.0:1787574508.780647:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787574508.780657:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab000, rc 0) 00000100:00100000:2.0:1787574508.780713:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:12409:x1874407323693568:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 317us (607us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787574508.780720:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 202 00000100:00100000:1.0:1787574508.784700:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574508.784850:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323693696 00000100:00100000:3.0:1787574508.784860:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323693696 00000100:00100000:3.0:1787574508.784927:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 203 00000100:00100000:3.0:1787574508.784944:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b69e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:12409:x1874407323693696:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:3.0:1787574508.785029:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8c2c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785047:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8c2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785059:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8c2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785073:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785080:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785086:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785163:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8c3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785171:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785177:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574508.785219:0:8610:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785230:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8c2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785270:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8c2c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785277:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8c2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785283:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574508.785288:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8c2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785295:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8c2c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785307:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574508.785311:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574508.785315:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8c2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785321:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8c2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785333:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785340:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785345:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785351:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421faa00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574508.785359:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785365:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785373:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca600) 00010000:00010000:3.0:1787574508.785376:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574508.785379:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785384:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8c33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785397:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785403:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8c3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785410:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8c3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785415:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574508.785418:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8c3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785423:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8c3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785430:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca5186ca700) 00010000:00010000:3.0:1787574508.785432:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574508.785439:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8c3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574508.785445:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8c3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574508.785524:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b69e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:12409:x1874407323693696:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 582us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574508.785533:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 203 00000100:00100000:0.0:1787574508.827963:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574508.828112:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323693952 00000100:00100000:3.0:1787574508.828122:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323693952 00000100:00100000:3.0:1787574508.828184:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 204 00000100:00100000:3.0:1787574508.828196:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+25:12412:x1874407323693952:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574508.828220:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574508.828420:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8c41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b937 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828510:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb8c48 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828525:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb8c48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828538:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb8c48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828554:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8c4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828561:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8c4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828568:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8c4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828684:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8c56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828692:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8c56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828717:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8c56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574508.828729:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787574508.828810:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb8c48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828818:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb8c48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828824:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb8c48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828831:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409de00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574508.828835:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb8c48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828842:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb8c48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828854:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:0.0:1787574508.828857:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574508.828862:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb8c48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828867:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb8c48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828881:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8c4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828886:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8c4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828911:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8c4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828916:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409ce00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574508.828919:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8c4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828925:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8c4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828933:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca534a50700) 00010000:00010000:0.0:1787574508.828936:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574508.828939:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8c4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.828944:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb8c4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.829000:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8c41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b937 expref: 28 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.829013:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8c56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b937 expref: 27 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574508.829020:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:0.0:1787574508.829022:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574508.829024:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409ca00, rc 0) 00000100:00100000:0.0:1787574508.829132:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:12412:x1874407323693952:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 937us (1179us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1787574508.829149:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 204 00000100:00100000:3.0:1787574508.834464:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.834573:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323694080 00000100:00100000:2.0:1787574508.834582:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323694080 00000100:00100000:2.0:1787574508.834722:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 205 00000100:00100000:2.0:1787574508.834733:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:12412:x1874407323694080:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1787574508.834795:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.834811:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.834823:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.834863:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.834871:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.834878:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.834884:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574508.834897:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.834905:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.834930:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:2.0:1787574508.834934:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574508.834939:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c64 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.834945:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.835064:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:12412:x1874407323694080:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 333us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574508.835071:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 205 00000100:00100000:1.0:1787574508.837462:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.837563:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323694336 00000100:00100000:2.0:1787574508.837571:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323694336 00000100:00100000:2.0:1787574508.837659:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:2.0:1787574508.837669:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:12412:x1874407323694336:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1787574508.837869:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+28:12412:x1874407323694336:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 200us (416us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1787574508.837877:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:2.0:1787574508.870672:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574508.870759:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323694592 00000100:00100000:1.0:1787574508.870769:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323694592 00000100:00100000:1.0:1787574508.870832:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 206 00000100:00100000:1.0:1787574508.870843:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+28:11945:x1874407323694592:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574508.870870:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574508.870891:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8c6b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b93e expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.871013:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.871027:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8c56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b937 expref: 29 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.871046:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.871096:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8c56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b937 expref: 29 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.871110:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8c56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b937 expref: 29 pid: 6509 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574508.871124:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346829952:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574508.871228:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574508.874054:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.874121:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323694720 00000100:00100000:2.0:1787574508.874130:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323694720 00010000:00010000:2.0:1787574508.874170:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8c56 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b937 expref: 30 pid: 6509 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.874216:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:2.0:1787574508.874226:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:2404:x1874407323694720:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574508.874277:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574508.874297:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8c56 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b937 expref: 30 pid: 6509 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.874311:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8c56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b937 expref: 30 pid: 6509 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.874331:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:2.0:1787574508.874336:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.874346:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.874352:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.874369:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574508.874414:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:2404:x1874407323694720:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 189us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574508.874421:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 92 00010000:00010000:1.0:1787574508.874735:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8c56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b937 expref: 29 pid: 6509 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574508.874751:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346829952:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574508.874771:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.874780:0:11515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.874786:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574508.874988:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787574508.875119:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8c6b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b93e expref: 30 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.875133:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b93e expref: 29 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.875153:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:1.0:1787574508.875156:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787574508.875159:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19800, rc 0) 00000100:00100000:1.0:1787574508.875202:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:11945:x1874407323694592:12345-192.168.202.40@tcp:101:bash.0 Request processed in 4360us (4540us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1787574508.875209:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 206 00000100:00100000:0.0:1787574508.877318:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.877422:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323694848 00000100:00100000:2.0:1787574508.877432:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323694848 00000100:00100000:2.0:1787574508.877519:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 207 00000100:00100000:2.0:1787574508.877529:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:11945:x1874407323694848:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574508.877550:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574508.877570:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b945 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.877599:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8c87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.877636:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8c87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.877647:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8c87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.877751:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa600/0xd18a1efeeddb8c80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b945 expref: 31 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.877770:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8c87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b945 expref: 30 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.877778:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:2.0:1787574508.877781:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787574508.877784:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab800, rc 0) 00000100:00100000:2.0:1787574508.877837:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:11945:x1874407323694848:12345-192.168.202.40@tcp:101:bash.0 Request processed in 310us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574508.877843:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 207 00000100:00100000:3.0:1787574508.880691:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.880756:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323695104 00000100:00100000:2.0:1787574508.880764:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323695104 00000100:00100000:2.0:1787574508.880817:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 208 00000100:00100000:2.0:1787574508.880825:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:11945:x1874407323695104:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:2.0:1787574508.881045:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.881060:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.881086:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574508.881124:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:2.0:1787574508.881144:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e457352 reply state 00000000fbf83b8d transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.881156:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.881163:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:2.0:1787574508.881165:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787574508.881168:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787574508.881233:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:2.0:1787574508.881352:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:11945:x1874407323695104:12345-192.168.202.40@tcp:36:bash.0 Request processed in 527us (668us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787574508.881360:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 208 00000020:00080000:2.0:1787574508.881365:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787574508.884422:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574508.884508:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323695232 00000100:00100000:1.0:1787574508.884518:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323695232 00000100:00100000:1.0:1787574508.884580:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 209 00000100:00100000:1.0:1787574508.884590:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+34:11945:x1874407323695232:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574508.884614:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574508.884634:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8c95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b94c expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.884690:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8c95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b94c expref: 35 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.884706:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8c95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b94c expref: 35 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574508.884725:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:1.0:1787574508.884728:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787574508.884732:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19600, rc 0) 00000100:00100000:1.0:1787574508.884788:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:11945:x1874407323695232:12345-192.168.202.40@tcp:101:bash.0 Request processed in 199us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574508.884809:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 209 00000100:00100000:3.0:1787574508.888016:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.888110:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323695360 00000100:00100000:2.0:1787574508.888120:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323695360 00000100:00100000:2.0:1787574508.888179:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:2.0:1787574508.888190:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:11945:x1874407323695360:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574508.888209:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574508.888229:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb578a0f/0xd18a1efeeddb8c9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b953 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574508.888287:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c38eb, atime: 0x6a8c38e8, ctime: 0x6a8c38eb, blocks: 0x8 00010000:00010000:2.0:1787574508.888308:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=448s v=(0 0) 00010000:00010000:2.0:1787574508.888326:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574508.888334:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb578a0f/0xd18a1efeeddb8c9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b953 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.888352:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb578a0f/0xd18a1efeeddb8c9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b953 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.888388:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faa600, rc 0) 00000100:00100000:2.0:1787574508.888440:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:11945:x1874407323695360:12345-192.168.202.40@tcp:101:bash.0 Request processed in 251us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574508.888446:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:3.0:1787574508.891357:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.891463:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323695488 00000100:00100000:2.0:1787574508.891472:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323695488 00002000:00010000:2.0:1787574508.891512:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1787574508.891517:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404389500 with x1874407323695488 ext(0->18446744073709551615) 00002000:00010000:2.0:1787574508.891528:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca404389500. 00000100:00100000:2.0:1787574508.891561:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:2.0:1787574508.891571:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2402:x1874407323695488:12345-192.168.202.40@tcp:10:bash.0 00002000:00010000:2.0:1787574508.891828:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787574508.891832:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787574507 -> 1787574508 00002000:00010000:2.0:1787574508.891835:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787574504 -> 1787574504 00002000:00010000:2.0:1787574508.891837:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787574507 -> 1787574508 00002000:00010000:2.0:1787574508.891839:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787574508.891905:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2402:x1874407323695488:12345-192.168.202.40@tcp:10:bash.0 Request processed in 335us (557us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787574508.891914:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00002000:00010000:2.0:1787574508.891927:0:8431:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1787574508.891929:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404389500 with x1874407323695488 ext(0->18446744073709551615) 00002000:00010000:2.0:1787574508.891935:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca404389500. 00000100:00100000:1.0:1787574508.981553:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574508.981789:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323695616 00000100:00100000:2.0:1787574508.981798:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323695616 00000100:00100000:2.0:1787574508.981909:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 210 00000100:00100000:2.0:1787574508.981919:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:12426:x1874407323695616:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:2.0:1787574508.982011:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ca3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982029:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982042:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982057:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8caa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982065:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8caa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982071:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8caa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982137:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982144:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982149:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787574508.982200:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982210:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982214:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ca3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982219:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982222:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabe00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574508.982225:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982230:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ca3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982266:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:2.0:1787574508.982273:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574508.982278:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ca3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982284:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ca3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982298:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8caa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982303:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8caa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982314:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8caa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982317:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faaa00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574508.982318:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8caa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982322:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8caa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982328:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca520573400) 00010000:00010000:2.0:1787574508.982329:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574508.982331:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8caa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982335:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8caa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982345:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982348:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982352:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982355:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574508.982357:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982368:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982373:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:2.0:1787574508.982374:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574508.982377:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574508.982383:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574508.982473:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:12426:x1874407323695616:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 555us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574508.982480:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 210 00000100:00100000:0.0:1787574509.066807:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.066913:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323695872 00000100:00100000:2.0:1787574509.066924:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323695872 00000100:00100000:2.0:1787574509.066995:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 211 00000100:00100000:2.0:1787574509.067006:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+35:12429:x1874407323695872:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574509.067027:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574509.067046:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b95a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067106:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cbf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067117:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067125:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067147:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8cc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067152:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067156:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067275:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8ccd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067281:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8ccd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067285:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8ccd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574509.067292:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787574509.067352:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067357:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cbf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067362:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067365:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faaa00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574509.067368:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067384:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cbf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067396:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:2.0:1787574509.067398:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574509.067413:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cbf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067419:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cbf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067442:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067448:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8cc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067453:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067457:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabe00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574509.067460:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067465:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067472:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca520573400) 00010000:00010000:2.0:1787574509.067474:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574509.067477:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8cc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067491:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8cc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067532:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8cb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b95a expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067544:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8ccd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b95a expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.067550:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:2.0:1787574509.067552:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787574509.067555:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faa200, rc 0) 00000100:00100000:2.0:1787574509.067618:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12429:x1874407323695872:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 614us (818us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787574509.067623:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 211 00000100:00100000:1.0:1787574509.071602:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574509.071707:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323696000 00000100:00100000:3.0:1787574509.071715:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323696000 00000100:00100000:3.0:1787574509.071762:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 212 00000100:00100000:3.0:1787574509.071769:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12429:x1874407323696000:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1787574509.071825:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.071839:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b93e expref: 37 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.071846:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.071993:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b93e expref: 37 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.072007:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b93e expref: 37 pid: 11515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574509.072022:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346830080:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574509.072159:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574509.082224:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.082345:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323696256 00000100:00100000:2.0:1787574509.082355:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323696256 00000100:00100000:2.0:1787574509.082433:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:2.0:1787574509.082446:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:6176:x1874407323696256:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787574509.082831:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:6176:x1874407323696256:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 387us (617us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787574509.082841:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:3.0:1787574509.083589:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346830080:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574509.083680:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574509.088463:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.088638:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323696384 00000100:00100000:2.0:1787574509.088650:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323696384 00010000:00010000:2.0:1787574509.088692:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b93e expref: 39 pid: 11515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574509.088756:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:2.0:1787574509.088766:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:2405:x1874407323696384:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574509.088783:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574509.088790:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b93e expref: 39 pid: 11515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.088802:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b93e expref: 39 pid: 11515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.088824:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8c72 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b93e expref: 39 pid: 11515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.088841:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:2.0:1787574509.088846:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.088856:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.088864:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.088969:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574509.089047:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:2405:x1874407323696384:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 282us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574509.089055:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 93 00010000:00010000:3.0:1787574509.089313:0:11515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.089323:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.089365:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.089373:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.089380:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.089385:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574509.089390:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.089415:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.089430:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:3.0:1787574509.089434:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574509.089437:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.089443:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8cdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574509.089485:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12429:x1874407323696000:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 17715us (17890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574509.089492:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 212 00000100:00100000:1.0:1787574509.108163:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.110361:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323696640 00000100:00100000:2.0:1787574509.110391:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323696640 00000100:00100000:0.0:1787574509.111072:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:0.0:1787574509.111088:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+37:12429:x1874407323696640:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1787574509.111352:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:12429:x1874407323696640:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 269us (3198us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787574509.111362:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:1.0:1787574509.205763:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.205828:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323696896 00000100:00100000:2.0:1787574509.205838:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323696896 00000100:00100000:2.0:1787574509.205927:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 213 00000100:00100000:2.0:1787574509.205936:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+38:12440:x1874407323696896:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:2.0:1787574509.205963:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574509.206008:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8ce2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b961 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206142:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ce9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206155:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206166:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206178:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206184:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206190:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206332:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8cf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206339:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206357:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574509.206364:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787574509.206673:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206679:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ce9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206683:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206687:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabe00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574509.206691:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206695:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ce9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206704:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:2.0:1787574509.206706:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574509.206709:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ce9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206712:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ce9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206723:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206726:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cf0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206737:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206740:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faaa00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574509.206741:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206745:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206749:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca520573400) 00010000:00010000:2.0:1787574509.206750:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574509.206752:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cf0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206755:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8cf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206786:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8ce2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b961 expref: 41 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206795:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b961 expref: 40 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.206800:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:2.0:1787574509.206801:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574509.206803:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fabc00, rc 0) 00000100:00100000:2.0:1787574509.206856:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12440:x1874407323696896:12345-192.168.202.40@tcp:101:cat.0 Request processed in 921us (1105us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787574509.206878:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 213 00000100:00100000:3.0:1787574509.210117:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574509.210284:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323697152 00000100:00100000:0.0:1787574509.210294:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323697152 00000100:00100000:0.0:1787574509.210350:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:0.0:1787574509.210362:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+40:12440:x1874407323697152:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:0.0:1787574509.210823:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+41:12440:x1874407323697152:12345-192.168.202.40@tcp:35:cat.0 Request processed in 463us (716us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787574509.210828:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:1.0:1787574509.226442:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574509.226534:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323697408 00000100:00100000:3.0:1787574509.226544:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323697408 00000100:00100000:3.0:1787574509.226611:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 214 00000100:00100000:3.0:1787574509.226693:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+41:12441:x1874407323697408:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1787574509.226750:0:8610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787574509.226777:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8c95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b94c expref: 41 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.226800:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8cf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b961 expref: 40 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.226816:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8ccd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b95a expref: 39 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.226855:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8c87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b945 expref: 38 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.226865:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:3.0:1787574509.226871:0:8610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574509.227482:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d05 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.227500:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.227510:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.227526:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.227534:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.227540:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228176:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228187:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228194:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574509.228440:0:8610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:3.0:1787574509.228491:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8d1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228500:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8d1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228508:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8d1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228515:0:8610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8d1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228521:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8d1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228527:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8d1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228552:0:8610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574509.228572:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228579:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d13 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228585:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228591:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574509.228595:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.228609:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d13 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.229293:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574509.229303:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8d1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.229310:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574509.229313:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8d1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.229332:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8d1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.229345:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:0.0:1787574509.229348:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787574509.229352:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8d1a lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.229358:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8d1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.229374:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574509.229376:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574509.229378:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574509.229428:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:3.0:1787574509.229432:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787574509.229435:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d13 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.229442:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d13 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.229459:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.229465:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d05 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.229471:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.229477:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574509.229479:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.229484:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.229493:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574509.229495:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574509.229498:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d05 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.229514:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574509.229525:0:8610:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d593baec reply state 00000000b5f1a41a transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.229537:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.229543:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca700) 00010000:00010000:3.0:1787574509.229545:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574509.229548:0:8610:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787574509.229750:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:12441:x1874407323697408:12345-192.168.202.40@tcp:36:rm.0 Request processed in 3126us (3314us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787574509.229759:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 214 00010000:00010000:2.0:1787574509.234907:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574509.286626:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574509.287026:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323697664 00000100:00100000:3.0:1787574509.287046:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323697664 00000100:00100000:3.0:1787574509.287112:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 215 00000100:00100000:3.0:1787574509.287123:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+39:12447:x1874407323697664:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1787574509.287149:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574509.287170:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d21 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b968 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287316:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d28 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287332:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287359:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287371:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287378:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287385:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787574509.287700:0:11515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787574509.287830:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb8d36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287839:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb8d36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287845:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb8d36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287876:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287883:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d28 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287904:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d28 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287911:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574509.287922:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d28 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287930:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d28 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287942:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574509.287946:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574509.287950:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d28 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287957:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d28 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574509.287979:0:11515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014d1fdd7 reply state 0000000009c59b0c transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287989:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.287994:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca700) 00010000:00010000:3.0:1787574509.287996:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574509.287999:0:11515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787574509.288025:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d21 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b968 expref: 42 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.288039:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb8d36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b968 expref: 41 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.288046:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:3.0:1787574509.288048:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574509.288056:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb200, rc 0) 00000100:00100000:3.0:1787574509.288114:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+42:12447:x1874407323697664:12345-192.168.202.40@tcp:101:bash.0 Request processed in 993us (1507us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787574509.288122:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 215 00000100:00100000:0.0:1787574509.293706:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574509.293827:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323697792 00000100:00100000:3.0:1787574509.293837:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323697792 00000100:00100000:3.0:1787574509.293921:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:3.0:1787574509.293932:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323697792:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1787574509.293947:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574509.293967:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed45b8c2/0xd18a1efeeddb8d44 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b96f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787574509.294002:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574509.294021:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=448s v=(0 0) 00010000:00010000:3.0:1787574509.294026:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574509.294035:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed45b8c2/0xd18a1efeeddb8d44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b96f expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.294052:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed45b8c2/0xd18a1efeeddb8d44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b96f expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.294066:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa400, rc 0) 00000100:00100000:3.0:1787574509.294124:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323697792:12345-192.168.202.40@tcp:101:bash.0 Request processed in 195us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574509.294131:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00080000:2.0:1787574509.294559:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574509.297637:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.297738:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323697920 00000100:00100000:2.0:1787574509.297748:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323697920 00000100:00100000:2.0:1787574509.297807:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:2.0:1787574509.297817:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:12447:x1874407323697920:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574509.297834:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574509.297852:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b976 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.297881:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed45b8c2/0xd18a1efeeddb8d44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b96f expref: 9 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.297890:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574509.297906:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574509.297912:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.297948:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed45b8c2/0xd18a1efeeddb8d44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b96f expref: 9 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.297963:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed45b8c2/0xd18a1efeeddb8d44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b96f expref: 9 pid: 8423 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574509.297986:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1874407346830208:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574509.298098:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574509.301351:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574509.301451:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323698048 00000100:00100000:0.0:1787574509.301461:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323698048 00010000:00010000:0.0:1787574509.301502:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed45b8c2/0xd18a1efeeddb8d44 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b96f expref: 10 pid: 8423 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574509.301545:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:0.0:1787574509.301557:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b688450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:2404:x1874407323698048:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574509.301572:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574509.301594:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed45b8c2/0xd18a1efeeddb8d44 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b96f expref: 10 pid: 8423 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.301609:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed45b8c2/0xd18a1efeeddb8d44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b96f expref: 10 pid: 8423 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.301663:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574509.301668:0:6494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574509.301677:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.301686:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.301722:0:6494:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 10 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574509.301736:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404057800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6494:1874407346830336:192.168.202.40@tcp:105: 00000100:00100000:0.0:1787574509.301818:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9600 going to sleep for 11 seconds 00010000:00010000:2.0:1787574509.302702:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed45b8c2/0xd18a1efeeddb8d44 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b96f expref: 10 pid: 8423 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574509.302721:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1874407346830208:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574509.302746:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.302757:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faa000, rc 0) 00000100:00100000:2.0:1787574509.302805:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:12447:x1874407323697920:12345-192.168.202.40@tcp:101:bash.0 Request processed in 4988us (5176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574509.302813:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:0.0:1787574509.306446:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404057800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6494:1874407346830336:192.168.202.40@tcp:105: 00010000:00010000:0.0:1787574509.306475:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574509.306532:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b688450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323698048:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 4977us (5190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574509.306542:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:3.0:1787574509.310690:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574509.310804:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323698304 00000100:00100000:0.0:1787574509.310815:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323698304 00000100:00100000:0.0:1787574509.310875:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:0.0:1787574509.311006:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+42:12447:x1874407323698304:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:0.0:1787574509.311344:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:12447:x1874407323698304:12345-192.168.202.40@tcp:35:bash.0 Request processed in 459us (664us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787574509.311370:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:1.0:1787574509.518438:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.518513:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323698432 00000100:00100000:2.0:1787574509.518523:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323698432 00000100:00100000:2.0:1787574509.518586:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 216 00000100:00100000:2.0:1787574509.518597:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+43:12463:x1874407323698432:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574509.518632:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574509.518654:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b97d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.518718:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8d59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.518732:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8d59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.518744:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8d59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574509.518796:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787574509.518800:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574509.518816:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8d59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.518838:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b97d expref: 45 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.518857:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8d59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b97d expref: 44 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.518865:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:2.0:1787574509.518869:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574509.518872:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fabe00, rc 0) 00000100:00100000:2.0:1787574509.518935:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+44:12463:x1874407323698432:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 340us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574509.518943:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 216 00000100:00100000:1.0:1787574509.526099:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574509.526194:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323698688 00000100:00100000:3.0:1787574509.526220:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323698688 00000100:00100000:3.0:1787574509.526324:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 217 00000100:00100000:3.0:1787574509.526337:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+44:12463:x1874407323698688:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574509.526357:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574509.526376:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b984 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.526493:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.526507:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.526520:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574509.526531:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787574509.526652:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8d60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b984 expref: 47 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.526672:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b984 expref: 46 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.526681:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:3.0:1787574509.526683:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574509.526688:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa400, rc 0) 00000100:00100000:3.0:1787574509.526760:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+46:12463:x1874407323698688:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 426us (671us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1787574509.526768:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 217 00000100:00100000:3.0:1787574509.531157:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574509.531210:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574509.531374:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323698816 00000100:00100000:0.0:1787574509.531385:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323698816 00000100:00100000:0.0:1787574509.531469:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:0.0:1787574509.531480:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+46:2404:x1874407323698816:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574509.531498:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574509.531524:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa400/0xd18a1efeeddb8d67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b984 expref: 46 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.531543:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574509.531547:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574509.531603:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+45:2404:x1874407323698816:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 125us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574509.531611:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1787574509.532101:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323699072 00000100:00100000:2.0:1787574509.532109:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323699072 00000100:00100000:2.0:1787574509.532151:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 218 00000100:00100000:2.0:1787574509.532160:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+45:12463:x1874407323699072:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574509.532187:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574509.532208:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8d75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b98b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.532349:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8d7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.532384:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8d7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.532394:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8d7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574509.532407:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787574509.532535:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8d75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b98b expref: 48 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.532553:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8d7c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b98b expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.532560:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:2.0:1787574509.532563:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787574509.532566:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faa800, rc 0) 00000100:00100000:2.0:1787574509.532759:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+47:12463:x1874407323699072:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 600us (1548us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1787574509.532767:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 218 00000100:00100000:3.0:1787574509.545207:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574509.545360:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323699200 00000100:00100000:0.0:1787574509.545373:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323699200 00000100:00100000:0.0:1787574509.545443:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:0.0:1787574509.545454:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2405:x1874407323699200:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:0.0:1787574509.545499:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.545521:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.545530:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574509.545534:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787574509.545552:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.545592:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.545607:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 8 pid: 8425 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574509.545622:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404057480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1874407346830464:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574509.545721:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4019d9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574509.549412:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404057480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1874407346830464:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574509.549442:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574509.552893:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574509.553004:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323699328 00000100:00100000:1.0:1787574509.553015:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323699328 00002000:00100000:1.0:1787574509.553068:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9ca404388a80 x1874407323699328/t0(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:280/0 lens 504/0 e 0 to 0 dl 1787574520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787574509.553079:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404388a80 with x1874407323699328 ext(0->8) 00010000:00010000:1.0:1787574509.553089:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 9 pid: 8425 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.553108:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 9 pid: 8425 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574509.553116:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ca404388a80 00000100:00100000:1.0:1787574509.553150:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:1.0:1787574509.553160:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2405:x1874407323699328:12345-192.168.202.40@tcp:4:lfs.0 00000100:00100000:1.0:1787574509.555768:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:2405:x1874407323699328:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 2599us (2880us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787574509.555782:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00002000:00100000:1.0:1787574509.555794:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9ca404388a80 x1874407323699328/t4294967309(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:280/0 lens 504/448 e 0 to 0 dl 1787574520 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787574509.555805:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca404388a80 with x1874407323699328 ext(0->8) 00010000:00010000:1.0:1787574509.555816:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 11 pid: 8425 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.555835:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 11 pid: 8425 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574509.555844:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ca404388a80 00000100:00100000:1.0:1787574509.560338:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574509.560565:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323699456 00000100:00100000:3.0:1787574509.560576:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323699456 00010000:00010000:3.0:1787574509.560632:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 11 pid: 8425 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574509.560721:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:3.0:1787574509.560731:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:2404:x1874407323699456:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574509.560744:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787574509.560761:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787574509.560764:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787574508 00002000:00010000:3.0:1787574509.560766:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787574509 00002000:00010000:3.0:1787574509.560768:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787574508 00002000:00010000:3.0:1787574509.560770:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787574509.560775:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 11 pid: 8425 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.560788:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 11 pid: 8425 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.560809:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037f30e03/0xd18a1efeeddb8d4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b976 expref: 11 pid: 8425 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.560826:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574509.560841:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574509.560847:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.560856:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.560899:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574509.561178:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:2404:x1874407323699456:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 447us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574509.561186:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 95 00010000:00010000:1.0:1787574509.561267:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.561277:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.561297:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.561305:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.561324:0:8423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.561332:0:8423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409dc00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574509.561336:0:8423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.561344:0:8423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.561357:0:8423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.561364:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007efab4da/0xd18a1efeeddb8d8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574509.561408:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2405:x1874407323699200:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 15957us (16212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574509.561415:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1787574509.571220:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574509.574755:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323699712 00000100:00100000:0.0:1787574509.574773:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323699712 00000100:00100000:0.0:1787574509.574856:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:0.0:1787574509.574868:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518c36050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+47:12463:x1874407323699712:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:0.0:1787574509.575168:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8d7c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b98b expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574509.575386:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787574509.575420:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1787574509.577901:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:1.0:1787574509.577986:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.578007:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb8d36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b968 expref: 51 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.578034:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.578074:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb8d36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b968 expref: 51 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.578090:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb8d36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b968 expref: 51 pid: 11515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574509.578105:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6513:1874407346830592:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574509.578202:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346000 going to sleep for 11 seconds 00000100:00100000:2.0:1787574509.582089:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574509.582280:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6513:1874407346830592:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574509.582312:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574509.582442:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323699840 00000100:00100000:0.0:1787574509.582450:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323699840 00010000:00010000:0.0:1787574509.582497:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb8d36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b968 expref: 52 pid: 11515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574509.582554:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:0.0:1787574509.582565:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+52:2405:x1874407323699840:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574509.582581:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574509.582589:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb8d36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b968 expref: 52 pid: 11515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.582601:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb8d36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b968 expref: 52 pid: 11515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.582636:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb200/0xd18a1efeeddb8d36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b968 expref: 52 pid: 11515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.582651:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:0.0:1787574509.582656:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.582665:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.582672:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.582699:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574509.582755:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+51:2405:x1874407323699840:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 192us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574509.582762:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 96 00010000:00010000:1.0:1787574509.582992:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.582999:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574509.583105:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1787574509.583220:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1787574509.583351:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346830720:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787574509.583405:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574509.583443:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574509.583505:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346830720 00000100:00100000:3.0:1787574509.583511:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346830720 00000100:00100000:3.0:1787574509.583566:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787574509.583575:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6513:x1874407346830720:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787574509.583659:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6513:x1874407346830720:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574509.583666:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1787574509.585623:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574509.585694:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346830720:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787574509.585835:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1787574509.585919:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404131c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346830848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787574509.585990:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574509.586341:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574509.589488:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346830848 00000100:00100000:3.0:1787574509.589503:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346830848 00000100:00100000:2.0:1787574509.589708:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787574509.589721:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6513:x1874407346830848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787574509.589935:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6513:x1874407346830848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 216us (3944us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787574509.589943:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787574509.590083:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404131c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1874407346830848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787574509.590147:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1787574509.590186:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.590196:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.590202:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.590207:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574509.590211:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.590219:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.590234:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:1.0:1787574509.590270:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787574509.590276:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.590283:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d91 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787574509.590410:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787574509.590484:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787574509.590495:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 448773253994ns, next at 449773251732ns, rc = 0 00000001:00080000:1.0:1787574509.590500:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1787574509.590520:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca5186ca600) 00010000:00010000:1.0:1787574509.590523:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787574509.590529:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb8d7c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b98b expref: 55 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574509.590627:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518c36050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+54:12463:x1874407323699712:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 15761us (19418us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787574509.590635:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000020:00080000:1.0:1787574509.590639:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787574509.595203:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574509.595430:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323699968 00000100:00100000:0.0:1787574509.595447:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323699968 00000100:00100000:0.0:1787574509.595510:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 219 00000100:00100000:0.0:1787574509.595522:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+54:12463:x1874407323699968:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574509.595546:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574509.595569:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8d98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b992 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.595637:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8d98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b992 expref: 55 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.595650:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8d98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b992 expref: 55 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.595667:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:0.0:1787574509.595670:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574509.595673:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d000, rc 0) 00000100:00100000:0.0:1787574509.595735:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+55:12463:x1874407323699968:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 215us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574509.595742:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 219 00000100:00100000:0.0:1787574509.602209:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574509.602304:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323700224 00000100:00100000:3.0:1787574509.602313:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323700224 00000100:00100000:3.0:1787574509.602393:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:3.0:1787574509.602404:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+55:12463:x1874407323700224:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1787574509.602657:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+56:12463:x1874407323700224:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 254us (457us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787574509.602665:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:2.0:1787574509.691116:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574509.691446:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323700352 00000100:00100000:1.0:1787574509.691458:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323700352 00000100:00100000:1.0:1787574509.691532:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 220 00000100:00100000:1.0:1787574509.691544:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+56:12473:x1874407323700352:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:1.0:1787574509.691619:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d9f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691635:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691647:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691659:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8da6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691685:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8da6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691692:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8da6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691767:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8dad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691775:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691781:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574509.691831:0:11515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691843:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691849:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d9f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691854:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691861:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574509.691865:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691871:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691903:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:1.0:1787574509.691906:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574509.691910:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691916:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8d9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691928:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8da6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691932:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8da6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691935:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8da6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691938:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574509.691940:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8da6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691943:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8da6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691955:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca700) 00010000:00010000:1.0:1787574509.691956:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574509.691958:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8da6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691961:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8da6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691989:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.691995:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8dad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.692001:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8dad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.692010:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574509.692013:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8dad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.692019:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8dad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.692026:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:1.0:1787574509.692028:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574509.692039:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8dad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.692046:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8dad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574509.692294:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+56:12473:x1874407323700352:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 749us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574509.692303:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 220 00000100:00100000:2.0:1787574509.739518:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574509.739703:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323700608 00000100:00100000:3.0:1787574509.739715:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323700608 00000100:00100000:3.0:1787574509.739787:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 221 00000100:00100000:3.0:1787574509.739797:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+56:12476:x1874407323700608:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574509.739819:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574509.739841:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8db4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b999 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.739923:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8dbb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.739938:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8dbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.739957:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8dbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.739977:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8dc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.739984:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.739991:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.740100:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8dc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.740108:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.740131:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574509.740140:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787574509.740220:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8dbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.740228:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8dbb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.740235:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8dbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.740811:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574509.740816:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8dbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.740824:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8dbb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.740839:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574509.740843:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574509.740847:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8dbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.740853:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8dbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.740868:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.740875:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8dc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.741013:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.741019:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fbe00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574509.741022:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.741028:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8dc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.741048:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca700) 00010000:00010000:3.0:1787574509.741051:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574509.741054:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8dc2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574509.741059:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8dc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.741546:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa200/0xd18a1efeeddb8db4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b999 expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.741564:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b999 expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.741572:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574509.741574:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574509.741577:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa000, rc 0) 00000100:00100000:2.0:1787574509.741770:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+58:12476:x1874407323700608:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1972us (2259us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1787574509.741780:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 221 00000100:00100000:0.0:1787574509.745692:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574509.746194:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323700736 00000100:00100000:3.0:1787574509.746205:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323700736 00000100:00100000:2.0:1787574509.746607:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 222 00000100:00100000:2.0:1787574509.746629:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+58:12476:x1874407323700736:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1787574509.746699:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8dd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.746716:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.746727:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.746764:0:8610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.746772:0:8610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8dd7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.746791:0:8610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.746798:0:8610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574509.746803:0:8610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.746811:0:8610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8dd7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.746823:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574509.746826:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574509.746830:0:8610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8dd7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.746836:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8dd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574509.746980:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+58:12476:x1874407323700736:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 362us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574509.746988:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 222 00000100:00100000:1.0:1787574509.750022:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.750148:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323700992 00000100:00100000:2.0:1787574509.750157:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323700992 00000100:00100000:2.0:1787574509.750258:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:2.0:1787574509.750268:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+58:12476:x1874407323700992:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1787574509.750489:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+59:12476:x1874407323700992:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 222us (474us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787574509.750497:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:3.0:1787574509.842646:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574509.844054:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323701248 00000100:00100000:1.0:1787574509.844066:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323701248 00000100:00100000:1.0:1787574509.844158:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 223 00000100:00100000:1.0:1787574509.844170:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+59:12486:x1874407323701248:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574509.844202:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574509.844205:0:11515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787574509.844236:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8d59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b97d expref: 59 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.844291:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:1.0:1787574509.844296:0:11515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574509.844310:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8dde lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9a0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.844414:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.844430:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8dc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b999 expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.844439:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.844477:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b999 expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.844491:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8dc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b999 expref: 59 pid: 6511 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574509.844504:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404130000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346830976:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574509.844620:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023466c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574509.847751:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.848043:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323701376 00000100:00100000:2.0:1787574509.848052:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323701376 00010000:00010000:2.0:1787574509.848091:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8dc9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b999 expref: 60 pid: 6511 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574509.848134:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:2.0:1787574509.848144:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:2404:x1874407323701376:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574509.848158:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574509.848165:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8dc9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b999 expref: 60 pid: 6511 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.848178:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8dc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b999 expref: 60 pid: 6511 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.848200:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574509.848206:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.848216:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.848223:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.848279:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574509.848328:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:2404:x1874407323701376:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 185us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574509.848335:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 97 00010000:00010000:1.0:1787574509.849370:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fa000/0xd18a1efeeddb8dc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b999 expref: 59 pid: 6511 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574509.849391:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404130000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346830976:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574509.849412:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.849422:0:11515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.849428:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574509.849446:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787574509.849583:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8dde lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a0 expref: 60 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.849600:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a0 expref: 59 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.849710:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:1.0:1787574509.849716:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787574509.849720:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19800, rc 0) 00000100:00100000:1.0:1787574509.849827:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+59:12486:x1874407323701248:12345-192.168.202.40@tcp:101:bash.0 Request processed in 5658us (7192us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787574509.849836:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 223 00000100:00100000:0.0:1787574509.854848:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.854917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323701504 00000100:00100000:2.0:1787574509.854941:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323701504 00000100:00100000:2.0:1787574509.855063:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 224 00000100:00100000:2.0:1787574509.855076:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+59:12486:x1874407323701504:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574509.855100:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574509.855122:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8df3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9a7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.855156:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8dfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.855171:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8dfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.855183:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8dfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.855338:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8df3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a7 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.855357:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8dfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a7 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.855366:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574509.855369:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787574509.855372:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faba00, rc 0) 00000100:00100000:2.0:1787574509.855427:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:12486:x1874407323701504:12345-192.168.202.40@tcp:101:bash.0 Request processed in 353us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574509.855434:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 224 00000100:00100000:3.0:1787574509.860978:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.861536:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323701760 00000100:00100000:2.0:1787574509.861563:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323701760 00000100:00100000:2.0:1787574509.861628:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 225 00000100:00100000:2.0:1787574509.861639:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+60:12486:x1874407323701760:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:2.0:1787574509.861876:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.861903:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.861915:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574509.861961:0:8610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:2.0:1787574509.861994:0:8610:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7546eae reply state 00000000a5b7701e transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.862007:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.862014:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574509.862017:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787574509.862020:0:8610:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787574509.862127:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+63:12486:x1874407323701760:12345-192.168.202.40@tcp:36:bash.0 Request processed in 489us (1168us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787574509.862135:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 225 00000020:00080000:2.0:1787574509.862139:0:8610:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787574509.865028:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574509.865314:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323701888 00000100:00100000:1.0:1787574509.865337:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323701888 00000100:00100000:1.0:1787574509.865384:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 226 00000100:00100000:1.0:1787574509.865396:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+63:12486:x1874407323701888:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574509.865422:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574509.865445:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8e08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9ae expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.865535:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.865551:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a0 expref: 64 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.865560:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.865594:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a0 expref: 64 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.865607:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a0 expref: 64 pid: 11515 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574509.865634:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404130000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346831104:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574509.865875:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574509.870861:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574509.870934:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323702016 00000100:00100000:0.0:1787574509.870945:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323702016 00010000:00010000:0.0:1787574509.870998:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a0 expref: 65 pid: 11515 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574509.871059:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:0.0:1787574509.871069:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+65:2405:x1874407323702016:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574509.871085:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574509.871092:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a0 expref: 65 pid: 11515 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.871107:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a0 expref: 65 pid: 11515 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.871130:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:0.0:1787574509.871136:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.871146:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.871154:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.871174:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574509.871437:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8de5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a0 expref: 65 pid: 11515 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574509.871454:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404130000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346831104:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574509.871775:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.871784:0:11515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.871789:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574509.871841:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787574509.871846:0:11515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574509.871866:0:11515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.871910:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb8e08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ae expref: 65 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.871926:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ae expref: 64 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.871933:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574509.871936:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574509.871938:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e18600, rc 0) 00000100:00100000:0.0:1787574509.872066:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+64:2405:x1874407323702016:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 997us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574509.872075:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:2.0:1787574509.875351:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+63:12486:x1874407323701888:12345-192.168.202.40@tcp:101:bash.0 Request processed in 9943us (10318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574509.875365:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 226 00000100:00100000:1.0:1787574509.880370:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574509.880457:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323702272 00000100:00100000:3.0:1787574509.880475:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323702272 00000100:00100000:3.0:1787574509.880525:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1787574509.880536:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+63:12486:x1874407323702272:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:3.0:1787574509.880767:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+64:12486:x1874407323702272:12345-192.168.202.40@tcp:35:bash.0 Request processed in 233us (407us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787574509.880783:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1787574509.962507:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.962595:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323702400 00000100:00100000:2.0:1787574509.962604:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323702400 00000100:00100000:2.0:1787574509.962667:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 227 00000100:00100000:2.0:1787574509.962676:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+64:12492:x1874407323702400:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574509.962709:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574509.962726:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8e16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.962783:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8e1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.962796:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8e1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.962806:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8e1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574509.962845:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787574509.962849:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574509.962869:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8e1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.962901:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8e16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9b5 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.962919:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8e1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9b5 expref: 65 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.962928:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:2.0:1787574509.962930:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574509.962934:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab800, rc 0) 00000100:00100000:2.0:1787574509.963026:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+65:12492:x1874407323702400:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 350us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574509.963146:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 227 00000100:00100000:0.0:1787574509.966596:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.966644:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323702528 00000100:00100000:2.0:1787574509.966654:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323702528 00000100:00100000:2.0:1787574509.966718:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 228 00000100:00100000:2.0:1787574509.966730:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+65:12492:x1874407323702528:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574509.966750:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574509.966771:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9bc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.966836:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.966849:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.966859:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.966869:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.966876:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.966893:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.966980:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.966990:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967014:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574509.967065:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787574509.967069:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574509.967086:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967098:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967106:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967112:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e2b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967120:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967126:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabc00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574509.967131:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967139:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967152:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:2.0:1787574509.967155:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574509.967160:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967178:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967195:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967202:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967208:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967213:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabe00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574509.967216:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967223:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967231:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca700) 00010000:00010000:2.0:1787574509.967234:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574509.967266:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967273:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967301:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9bc expref: 67 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967316:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9bc expref: 66 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.967329:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574509.967332:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574509.967335:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab600, rc 0) 00000100:00100000:2.0:1787574509.967565:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:12492:x1874407323702528:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 836us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574509.967573:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 228 00000100:00100000:1.0:1787574509.971845:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.971921:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323702784 00000100:00100000:2.0:1787574509.971931:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323702784 00000100:00100000:2.0:1787574509.972002:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 229 00000100:00100000:2.0:1787574509.972013:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:12492:x1874407323702784:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574509.972041:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574509.972063:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8e40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9c3 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.972170:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.972186:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ae expref: 67 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.972195:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9bc expref: 67 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.972204:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.972271:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9bc expref: 67 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.972299:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9bc expref: 67 pid: 6509 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574509.972314:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346831232:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574509.972574:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ae expref: 67 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.972585:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ae expref: 67 pid: 11515 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574509.972594:0:11515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346831360:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574509.972630:0:11515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574509.974973:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574509.975310:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323702912 00000100:00100000:0.0:1787574509.975319:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323702912 00010000:00010000:0.0:1787574509.975360:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9bc expref: 68 pid: 6509 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574509.975431:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:0.0:1787574509.975442:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+68:2405:x1874407323702912:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574509.975456:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574509.975462:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9bc expref: 68 pid: 6509 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.975475:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9bc expref: 68 pid: 6509 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.975496:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:0.0:1787574509.975501:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.975509:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.975516:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574509.975557:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+68:2405:x1874407323702912:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 117us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574509.975565:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 99 00010000:00010000:2.0:1787574509.979437:0:11515:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.40@tcp) returned -22 from blocking AST (req@000000001ef45a99 x1874407346831232) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9bc expref: 67 pid: 6509 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.979462:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8e39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9bc expref: 67 pid: 6509 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574509.979482:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346831232:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574509.981638:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574509.981750:0:11515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11515:1874407346831360:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574509.981780:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:1.0:1787574509.981802:0:11515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.981815:0:11515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.981824:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574509.981863:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323703040 00000100:00100000:0.0:1787574509.981871:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323703040 00010000:00010000:0.0:1787574509.981907:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ae expref: 67 pid: 11515 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574509.981947:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:0.0:1787574509.981959:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b689c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+67:2405:x1874407323703040:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574509.981990:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574509.981997:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ae expref: 67 pid: 11515 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.982009:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ae expref: 67 pid: 11515 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.982087:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8e0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ae expref: 67 pid: 11515 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.982104:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:0.0:1787574509.982107:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.982115:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.982122:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.983798:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574509.984023:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b689c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:2405:x1874407323703040:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 2060us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574509.984049:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 100 00010000:00010000:1.0:1787574509.985089:0:11515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.985103:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574509.985128:0:11515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787574509.985295:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa000/0xd18a1efeeddb8e40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9c3 expref: 67 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.985318:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9c3 expref: 66 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574509.985326:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:1.0:1787574509.985329:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787574509.985331:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab200, rc 0) 00000100:00100000:1.0:1787574509.985385:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:12492:x1874407323702784:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 13365us (13543us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787574509.985394:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 229 00000100:00100000:3.0:1787574509.990782:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574509.991208:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323703296 00000100:00100000:0.0:1787574509.991219:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323703296 00000100:00100000:0.0:1787574509.991419:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:0.0:1787574509.991431:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:12492:x1874407323703296:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:0.0:1787574509.991464:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574509.991491:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8d98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b992 expref: 66 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574509.991510:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:0.0:1787574509.991516:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574509.991579:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+65:12492:x1874407323703296:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 150us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574509.991587:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:3.0:1787574509.996325:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574509.996461:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323703424 00000100:00100000:2.0:1787574509.996471:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323703424 00000100:00100000:2.0:1787574509.996542:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 230 00000100:00100000:2.0:1787574509.996567:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+65:12492:x1874407323703424:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:2.0:1787574509.996694:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.996710:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574509.996721:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787574509.996827:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787574509.996948:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+65:12492:x1874407323703424:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 383us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574509.996956:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 230 00000100:00100000:2.0:1787574510.002417:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.002571:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323703552 00000100:00100000:0.0:1787574510.002581:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323703552 00000100:00100000:0.0:1787574510.002762:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 231 00000100:00100000:0.0:1787574510.002774:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+65:12492:x1874407323703552:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574510.002794:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574510.002982:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8e5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9ca expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.003039:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.003051:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8e5c lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ca expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.003069:0:6510:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.003082:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8e5c lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ca expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.003112:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:0.0:1787574510.003115:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574510.003120:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8e5c lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ca expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.003128:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d000, rc 0) 00000100:00100000:0.0:1787574510.003225:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:12492:x1874407323703552:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 454us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574510.003233:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 231 00000100:00080000:1.0:1787574510.003321:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787574510.258160:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787574510.322527:0:8616:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 449505284609ns, next at 450505282151ns, rc = 0 00000100:00100000:0.0:1787574510.326786:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574510.326818:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346831488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574510.326909:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574510.328348:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346831488 00000100:00100000:2.0:1787574510.328361:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346831488 00000100:00100000:2.0:1787574510.328455:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787574510.328468:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346831488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574510.328500:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787574510.328565:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346831488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574510.328573:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1787574510.328860:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574510.329896:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574510.329918:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346831616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574510.330004:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574510.330697:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346831488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574510.332708:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346831616 00000100:00100000:2.0:1787574510.332724:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346831616 00000100:00100000:2.0:1787574510.332815:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787574510.332825:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346831616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574510.332884:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00080000:1.0:1787574510.333408:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574510.333702:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346831616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 876us (3695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574510.333711:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787574510.334811:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346831616:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1787574510.579344:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574510.579352:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574510.579391:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787574510.579400:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787574510.579514:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346831744:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787574510.579620:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574510.587527:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346831744:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787574510.591713:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574510.591833:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323703680 00000100:00100000:1.0:1787574510.591843:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323703680 00000100:00100000:1.0:1787574510.591914:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 232 00000100:00100000:1.0:1787574510.591924:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:12494:x1874407323703680:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787574510.591954:0:11515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787574510.592079:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:12494:x1874407323703680:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 156us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574510.592087:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 232 00000100:00100000:2.0:1787574510.604327:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.606401:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323703808 00000100:00100000:0.0:1787574510.606416:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323703808 00000100:00100000:0.0:1787574510.606503:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 233 00000100:00100000:0.0:1787574510.606516:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:12494:x1874407323703808:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787574510.606588:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8e63 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.606605:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8e63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.606615:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8e63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607059:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607069:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607077:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607103:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607112:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607119:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574510.607166:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787574510.607170:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574510.607183:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607194:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8e63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607200:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8e63 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607207:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8e63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607222:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574510.607226:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8e63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607233:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8e63 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607290:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:0.0:1787574510.607294:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574510.607297:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8e63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607303:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8e63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607317:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607322:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e6a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607327:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607332:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409dc00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574510.607335:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607341:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e6a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607359:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9ca534a50500) 00010000:00010000:0.0:1787574510.607361:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574510.607364:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e6a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607370:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e6a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607382:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607387:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607393:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607397:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574510.607399:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607405:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607411:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:0.0:1787574510.607413:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574510.607415:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.607421:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574510.607581:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:12494:x1874407323703808:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 1066us (3262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574510.607588:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 233 00000100:00100000:0.0:1787574510.611941:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574510.612284:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323704064 00000100:00100000:2.0:1787574510.612296:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323704064 00000100:00100000:2.0:1787574510.612347:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 234 00000100:00100000:2.0:1787574510.612358:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+66:12494:x1874407323704064:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574510.612378:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574510.612396:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e78 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.612500:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.612517:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.612527:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574510.612538:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787574510.612614:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.612622:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.612628:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.612648:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabc00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574510.612653:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.612675:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.612688:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574510.612691:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787574510.612696:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.612836:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8e7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.613101:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e78 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9d1 expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.613112:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:2.0:1787574510.613115:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787574510.613119:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8e78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9d1 expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.613129:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fabe00, rc 0) 00000100:00100000:2.0:1787574510.613205:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+67:12494:x1874407323704064:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 848us (1273us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1787574510.613213:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 234 00000100:00100000:1.0:1787574510.618232:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574510.618399:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323704192 00000100:00100000:2.0:1787574510.618425:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323704192 00000100:00100000:2.0:1787574510.618482:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 235 00000100:00100000:2.0:1787574510.618493:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+67:12494:x1874407323704192:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787574510.618529:0:6511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787574510.618646:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+67:12494:x1874407323704192:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 154us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574510.618654:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 235 00000100:00100000:3.0:1787574510.623151:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.623280:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323704448 00000100:00100000:0.0:1787574510.623290:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323704448 00000100:00100000:0.0:1787574510.623350:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 236 00000100:00100000:0.0:1787574510.623360:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+67:12494:x1874407323704448:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574510.623379:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574510.623382:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787574510.623409:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8e1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9b5 expref: 67 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.623430:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:0.0:1787574510.623435:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574510.623448:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e8d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9d8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787574510.624682:0:6509:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1787574510.624840:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.624877:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.624889:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.625003:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb8e8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9d8 expref: 69 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.625020:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9d8 expref: 68 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.625029:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca534a50500) 00010000:00010000:0.0:1787574510.625095:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574510.625099:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409dc00, rc 0) 00000100:00100000:0.0:1787574510.625167:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+68:12494:x1874407323704448:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1808us (2024us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787574510.625176:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 236 00000100:00100000:1.0:1787574510.634334:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574510.634479:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323704704 00000100:00100000:2.0:1787574510.634499:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323704704 00000100:00100000:2.0:1787574510.634563:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 237 00000100:00100000:2.0:1787574510.634574:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+68:12494:x1874407323704704:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787574510.634645:0:11515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574510.634684:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb8e94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9d8 expref: 68 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634714:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca534a50500) 00010000:00010000:2.0:1787574510.634725:0:11515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787574510.634748:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ea2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634762:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634773:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634822:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ea9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x47be909c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634847:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x47be909c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634855:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x47be909c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634921:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634929:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ea2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634935:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ea2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634941:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabe00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574510.634945:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ea2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634953:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ea2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634970:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:2.0:1787574510.634973:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574510.634977:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ea2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634982:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb8ea2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.634992:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x47be909c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.635005:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ea9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x47be909c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.635010:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x47be909c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.635015:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabc00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574510.635017:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x47be909c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.635023:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ea9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x47be909c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.635890:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x47be909c (ffff9ca520573400) 00010000:00010000:2.0:1787574510.635897:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574510.635902:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ea9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x47be909c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.635919:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ea9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x47be909c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574510.636106:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+67:12494:x1874407323704704:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 1461us (1709us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574510.636116:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 237 00000100:00100000:1.0:1787574510.642519:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.642917:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323704832 00000100:00100000:0.0:1787574510.642926:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323704832 00000100:00100000:0.0:1787574510.642997:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 238 00000100:00100000:0.0:1787574510.643008:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+67:12494:x1874407323704832:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574510.643026:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574510.643550:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8eb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9df expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.643589:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8eb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.643603:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.643615:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.643750:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb8eb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9df expref: 69 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.643770:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9df expref: 68 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.643791:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:1.0:1787574510.643794:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787574510.643798:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19400, rc 0) 00000100:00100000:1.0:1787574510.643863:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+68:12494:x1874407323704832:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 857us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574510.643880:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 238 00000100:00100000:3.0:1787574510.647395:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.647503:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323705088 00000100:00100000:0.0:1787574510.647513:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323705088 00000100:00100000:0.0:1787574510.647579:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 239 00000100:00100000:0.0:1787574510.647590:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+68:12494:x1874407323705088:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574510.647679:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.647695:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.647724:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574510.647891:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1787574510.647951:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005135ae0b reply state 00000000b16dadff transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.647973:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.647980:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:0.0:1787574510.647983:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787574510.647987:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574510.648526:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+70:12494:x1874407323705088:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 935us (1138us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787574510.648533:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 239 00000100:00100000:0.0:1787574510.656642:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574510.656759:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323705216 00000100:00100000:2.0:1787574510.656769:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323705216 00000100:00100000:2.0:1787574510.656826:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 240 00000100:00100000:2.0:1787574510.656835:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+70:12494:x1874407323705216:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574510.656858:0:11515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574510.656902:0:11515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ec5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9e6 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.656977:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9e6 expref: 71 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.656993:0:11515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9e6 expref: 71 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.657012:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:2.0:1787574510.657015:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574510.657018:0:11515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fabc00, rc 0) 00000100:00100000:2.0:1787574510.657091:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+71:12494:x1874407323705216:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 256us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574510.657098:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 240 00000100:00100000:1.0:1787574510.660644:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.661203:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323705344 00000100:00100000:0.0:1787574510.661214:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323705344 00000100:00100000:0.0:1787574510.661318:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:0.0:1787574510.661328:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2405:x1874407323705344:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787574510.661538:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:2405:x1874407323705344:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 211us (903us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787574510.661547:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00080000:1.0:1787574510.662168:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574510.681683:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574510.682648:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323705600 00000100:00100000:3.0:1787574510.682671:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323705600 00000100:00100000:3.0:1787574510.682745:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1787574510.682755:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+71:12494:x1874407323705600:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787574510.683019:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+72:12494:x1874407323705600:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 265us (1344us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1787574510.684156:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1787574510.694842:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574510.702105:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323705856 00000100:00100000:1.0:1787574510.702120:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323705856 00000100:00100000:1.0:1787574510.702198:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 241 00000100:00100000:1.0:1787574510.702209:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+72:12494:x1874407323705856:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787574510.702340:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+72:12494:x1874407323705856:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 132us (7506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574510.702348:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 241 00000100:00100000:1.0:1787574510.710021:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.710218:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323705984 00000100:00100000:0.0:1787574510.710228:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323705984 00000100:00100000:0.0:1787574510.710848:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 242 00000100:00100000:0.0:1787574510.710870:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+72:12494:x1874407323705984:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574510.710890:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574510.710917:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8ecc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.710991:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb8ed3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.711006:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb8ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.711018:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb8ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574510.711067:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574510.711085:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb8ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.711109:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb8ecc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ed expref: 74 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.711126:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb8ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ed expref: 73 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.711134:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:0.0:1787574510.711137:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787574510.711140:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409da00, rc 0) 00000100:00100000:0.0:1787574510.711201:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+73:12494:x1874407323705984:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 334us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574510.711219:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 242 00000100:00100000:0.0:1787574510.717874:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574510.719943:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323706112 00000100:00100000:2.0:1787574510.719967:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323706112 00000100:00100000:2.0:1787574510.720038:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:2.0:1787574510.720049:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+10:2404:x1874407323706112:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574510.720066:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574510.720088:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8eda lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9f4 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574510.720113:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c38ee, blocks: 0x0 00010000:00010000:2.0:1787574510.720135:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1787574510.720140:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574510.720149:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8eda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9f4 expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.720182:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8eda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9f4 expref: 11 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.720196:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fabe00, rc 0) 00000100:00100000:2.0:1787574510.720305:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:2404:x1874407323706112:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 257us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574510.720313:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:0.0:1787574510.725413:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574510.725577:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323706368 00000100:00100000:3.0:1787574510.725587:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323706368 00000100:00100000:3.0:1787574510.725653:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 243 00000100:00100000:3.0:1787574510.725663:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+73:12494:x1874407323706368:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787574510.725937:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+73:12494:x1874407323706368:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 274us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574510.725945:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 243 00000100:00100000:3.0:1787574510.745352:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.745387:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323706496 00000100:00100000:0.0:1787574510.745397:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323706496 00000100:00100000:0.0:1787574510.745457:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:0.0:1787574510.745467:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:12494:x1874407323706496:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574510.745484:0:8619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574510.745503:0:8619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9b9fb expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.745537:0:8619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8eda lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9f4 expref: 12 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.745545:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574510.745549:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574510.745553:0:8619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 12 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.745588:0:8619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8eda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9f4 expref: 12 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.745602:0:8619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8eda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9f4 expref: 12 pid: 8426 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574510.745615:0:8619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8619:1874407346831872:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574510.745731:0:8619:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca508f86f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574510.751793:0:8619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8619:1874407346831872:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574510.751829:0:8619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 12 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.751849:0:8619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409ca00, rc 0) 00000100:00100000:0.0:1787574510.751924:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:12494:x1874407323706496:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 6458us (6584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574510.751933:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:3.0:1787574510.753130:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.753233:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323706624 00000100:00100000:0.0:1787574510.753355:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323706624 00010000:00010000:2.0:1787574510.753587:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8eda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9f4 expref: 12 pid: 8426 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574510.753635:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:2.0:1787574510.753646:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:2405:x1874407323706624:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574510.754004:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574510.754027:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8eda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9f4 expref: 12 pid: 8426 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.754042:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8eda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9f4 expref: 12 pid: 8426 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.754065:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb8eda lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9f4 expref: 12 pid: 8426 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.754083:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574510.754099:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574510.754108:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 11 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.754118:0:7451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 11 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.754160:0:7451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 11 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574510.754176:0:7451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7451:1874407346832000:192.168.202.40@tcp:105: 00000100:00100000:2.0:1787574510.754307:0:7451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574510.759294:0:7451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7451:1874407346832000:192.168.202.40@tcp:105: 00010000:00010000:3.0:1787574510.759324:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574510.759377:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:2405:x1874407323706624:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 5733us (6253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574510.759388:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:0.0:1787574510.760806:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574510.761790:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323706752 00000100:00100000:3.0:1787574510.761802:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323706752 00002000:00100000:3.0:1787574510.761850:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9ca53bec2d80 x1874407323706752/t0(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:281/0 lens 504/0 e 0 to 0 dl 1787574521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787574510.761863:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca53bec2d80 with x1874407323706752 ext(0->12) 00002000:00010000:3.0:1787574510.761877:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca53bec2d80 00000100:00100000:3.0:1787574510.761909:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:3.0:1787574510.761919:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+11:2405:x1874407323706752:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787574510.766848:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:2405:x1874407323706752:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 4911us (6029us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787574510.766864:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00002000:00100000:2.0:1787574510.766886:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9ca53bec2d80 x1874407323706752/t4294967321(0) o4->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:281/0 lens 504/448 e 0 to 0 dl 1787574521 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787574510.766897:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca53bec2d80 with x1874407323706752 ext(0->12) 00002000:00010000:2.0:1787574510.766904:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca53bec2d80 00000100:00100000:0.0:1787574510.787585:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574510.788310:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323706880 00000100:00100000:2.0:1787574510.788321:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323706880 00000100:00100000:2.0:1787574510.788391:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 244 00000100:00100000:2.0:1787574510.788401:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+73:12494:x1874407323706880:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787574510.791415:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:0.0:1787574510.791439:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:0.0:1787574510.791473:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787574510.791499:0:6488:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ca402346900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787574510.791505:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca4023bdd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ca402346f00 00000020:00080000:0.0:1787574510.791508:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca4023bdb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ca4040c3600 00000020:00080000:0.0:1787574510.791550:0:6488:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ca4033eab40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787574510.791553:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca4040d9700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ca4033ead80 00000020:00080000:0.0:1787574510.791555:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca4040d9400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ca502fbfa00 00000020:00080000:0.0:1787574510.791578:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787574510.791636:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1787574510.791714:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791741:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791749:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791754:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574510.791759:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791766:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791782:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ca5186caa00) 00010000:00010000:2.0:1787574510.791784:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574510.791789:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791794:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8be6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791829:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574510.791831:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1787574510.791835:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791841:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791845:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faac00 already unused, calling callback (ffffffffc18d74f0) 00000100:00100000:1.0:1787574510.791847:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346832128:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787574510.791864:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791878:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791885:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ca534a50a00) 00010000:00010000:2.0:1787574510.791887:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574510.791890:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791895:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faac00/0xd18a1efeeddb8c8e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574510.791915:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574510.791917:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791923:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791928:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791932:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421faa00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574510.791935:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791940:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791947:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca700) 00010000:00010000:2.0:1787574510.791949:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574510.791969:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791975:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421faa00/0xd18a1efeeddb8d0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.791996:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792002:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792007:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792011:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574510.792014:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792020:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792026:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca700) 00000100:00100000:1.0:1787574510.792067:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:12494:x1874407323706880:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 3666us (4491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574510.792077:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 244 00010000:00010000:2.0:1787574510.792375:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574510.792380:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792386:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8d2f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792404:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574510.792409:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346832128 00000100:00100000:1.0:1787574510.792416:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346832128 00010000:00010000:2.0:1787574510.792419:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792424:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792429:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faaa00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574510.792431:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792437:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792445:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574510.792447:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574510.792451:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574510.792451:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1787574510.792456:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faaa00/0xd18a1efeeddb8e01 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574510.792463:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3637:x1874407346832128:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787574510.792467:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792472:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792477:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792481:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d600 already unused, calling callback (ffffffffc18d74f0) 00002000:00080000:1.0:1787574510.792486:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1787574510.792489:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792494:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792501:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:2.0:1787574510.792503:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787574510.792505:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.792510:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb8ebe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574510.792512:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c38ec, atime: 0x6a8c38ed, ctime: 0x6a8c38ec, blocks: 0x8 00010000:00010000:1.0:1787574510.792518:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb8ee8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.792531:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1787574510.792535:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574510.792542:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb8ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.792555:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb8ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.792563:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb8ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.792570:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb8ee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.792590:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574510.792693:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787574510.792835:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3637:x1874407346832128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 370us (918us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787574510.792841:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:1.0:1787574510.793080:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca404131180/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787574510.793087:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346832128:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787574510.793169:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346832256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787574510.793201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574510.793799:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb8ee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.793810:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574510.793814:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb8ee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.793823:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb8ee8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.793840:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb8ee8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.793847:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb8ee8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.793891:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574510.793894:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574510.793896:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574510.794700:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346832256 00000100:00100000:1.0:1787574510.794716:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346832256 00000100:00100000:1.0:1787574510.794777:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574510.794788:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346832256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787574510.794813:0:8425:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1787574510.794834:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.794851:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb578a0f/0xd18a1efeeddb8c9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b953 expref: 12 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.794859:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787574510.794864:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574510.794868:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.794897:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb578a0f/0xd18a1efeeddb8c9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b953 expref: 12 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.794910:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb578a0f/0xd18a1efeeddb8c9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b953 expref: 12 pid: 8425 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574510.794924:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1874407346832384:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574510.795007:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574510.802068:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1874407346832384:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574510.802097:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574510.802151:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574510.805732:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323707008 00000100:00100000:1.0:1787574510.805748:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323707008 00010000:00010000:1.0:1787574510.805799:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb578a0f/0xd18a1efeeddb8c9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b953 expref: 13 pid: 8425 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574510.805852:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 102 00000100:00100000:1.0:1787574510.805863:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+13:2404:x1874407323707008:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574510.805886:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574510.805892:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb578a0f/0xd18a1efeeddb8c9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b953 expref: 13 pid: 8425 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.805906:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb578a0f/0xd18a1efeeddb8c9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b953 expref: 13 pid: 8425 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.805928:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb578a0f/0xd18a1efeeddb8c9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b953 expref: 13 pid: 8425 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.805946:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574510.805951:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574510.805965:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.805976:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.806030:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574510.806104:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:2404:x1874407323707008:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 243us (3954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574510.806113:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 102 00000001:00080000:1.0:1787574510.807318:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1787574510.807330:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:3.0:1787574510.808524:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.808541:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.808552:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.808560:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.808593:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574510.808785:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574510.808793:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.808801:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574510.808805:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.808813:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.808833:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.808840:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005663ca29/0xd18a1efeeddb8eef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.808877:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574510.808879:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574510.808881:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574510.809235:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1874407346832256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14444us (16028us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787574510.809281:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:1.0:1787574510.810091:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca5045aa300/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787574510.810111:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346832256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787574510.810938:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574510.810992:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323707136 00000100:00100000:1.0:1787574510.811001:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323707136 00000100:00100000:1.0:1787574510.811059:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:1.0:1787574510.811069:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+12:2404:x1874407323707136:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787574510.813010:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1787574510.813023:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1787574510.813193:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323707136:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 2121us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574510.813204:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:2.0:1787574510.830457:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.830563:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323707392 00000100:00100000:0.0:1787574510.830573:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323707392 00000100:00100000:0.0:1787574510.830643:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 245 00000100:00100000:0.0:1787574510.830654:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:12494:x1874407323707392:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574510.830712:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574510.830753:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb8ed3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ed expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.830771:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:0.0:1787574510.830776:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574510.830802:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.830816:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.830825:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574510.830949:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013026128 reply state 00000000f3e04973 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.830972:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.830977:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:0.0:1787574510.830979:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574510.830982:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574510.831074:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:12494:x1874407323707392:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 421us (626us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1787574510.831081:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 245 00000100:00100000:0.0:1787574510.834740:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574510.834890:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323707520 00000100:00100000:3.0:1787574510.834899:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323707520 00000100:00100000:3.0:1787574510.834969:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:3.0:1787574510.834979:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323707520:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787574510.835135:0:8619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787574510.835139:0:8619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787574509 00002000:00010000:3.0:1787574510.835141:0:8619:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787574509 00002000:00010000:3.0:1787574510.835143:0:8619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787574510 -> 1787574509 00002000:00010000:3.0:1787574510.835160:0:8619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787574510.835223:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323707520:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 245us (493us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787574510.835493:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:2.0:1787574510.840550:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574510.840771:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323707776 00000100:00100000:3.0:1787574510.840780:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323707776 00000100:00100000:3.0:1787574510.840878:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 246 00000100:00100000:3.0:1787574510.840889:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:12494:x1874407323707776:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787574510.840977:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.840993:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8eb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9df expref: 22 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.841003:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.841043:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9df expref: 22 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.841059:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9df expref: 22 pid: 8610 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574510.841074:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346832512:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574510.841165:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574510.844633:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346832512:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574510.845163:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574510.845539:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.845771:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323707904 00000100:00100000:0.0:1787574510.845779:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323707904 00010000:00010000:0.0:1787574510.845816:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9df expref: 23 pid: 8610 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574510.845864:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:0.0:1787574510.845875:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+23:2405:x1874407323707904:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574510.845889:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574510.845896:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9df expref: 23 pid: 8610 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.845919:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9df expref: 23 pid: 8610 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.845941:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8eb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9df expref: 23 pid: 8610 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.845968:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:0.0:1787574510.845982:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.845992:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.845999:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.846030:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574510.846091:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:2405:x1874407323707904:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 218us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574510.846100:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 103 00010000:00010000:2.0:1787574510.846205:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.846224:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.846295:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.846302:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.846309:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.846314:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574510.846319:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.846325:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.846335:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:2.0:1787574510.846346:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787574510.846350:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.846357:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8efd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574510.846398:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:12494:x1874407323707776:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 5511us (5859us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787574510.846406:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 246 00000100:00100000:2.0:1787574510.853185:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574510.853318:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323708032 00000100:00100000:1.0:1787574510.853329:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323708032 00000100:00100000:1.0:1787574510.853388:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:1.0:1787574510.853399:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323708032:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787574510.853444:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.853464:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 8 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.853493:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787574510.853498:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574510.853503:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.853540:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 8 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.853555:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 8 pid: 8619 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574510.853569:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1874407346832640:192.168.202.40@tcp:104: 00000100:00100000:1.0:1787574510.853657:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346600 going to sleep for 11 seconds 00000100:00100000:2.0:1787574510.861022:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404131f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1874407346832640:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574510.861054:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574510.863011:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574510.863551:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323708160 00000100:00100000:1.0:1787574510.863560:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323708160 00010000:00010000:1.0:1787574510.863598:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 9 pid: 8619 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574510.864103:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:1.0:1787574510.864115:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2404:x1874407323708160:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574510.864131:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574510.864151:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 9 pid: 8619 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.864187:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 9 pid: 8619 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.864212:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d534f20c/0xd18a1efeeddb8ee1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9fb expref: 9 pid: 8619 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.864279:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574510.864284:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787574510.864290:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.864299:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.864543:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574510.864613:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2404:x1874407323708160:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 500us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574510.864621:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 104 00010000:00010000:3.0:1787574510.865685:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.865760:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.865785:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.865794:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.865802:0:8423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.865809:0:8423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574510.865814:0:8423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.865822:0:8423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.865837:0:8423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.865985:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb8f04 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574510.866461:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323708032:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 13060us (13283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574510.866472:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:2.0:1787574510.871186:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574510.871610:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323708416 00000100:00100000:1.0:1787574510.871621:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323708416 00000100:00100000:1.0:1787574510.871681:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 247 00000100:00100000:1.0:1787574510.871691:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:12494:x1874407323708416:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787574510.871767:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.871784:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8dfa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a7 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.871809:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.871844:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8dfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a7 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574510.872465:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8dfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a7 expref: 21 pid: 6511 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574510.872487:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404131f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1874407346832768:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574510.876088:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346180 going to sleep for 11 seconds 00000100:00100000:2.0:1787574510.889152:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404131f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1874407346832768:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574510.889184:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574510.890185:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.890274:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323708544 00000100:00100000:0.0:1787574510.890281:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323708544 00010000:00010000:0.0:1787574510.890319:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8dfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a7 expref: 22 pid: 6511 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574510.890401:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:0.0:1787574510.890412:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:2404:x1874407323708544:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574510.890427:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574510.890433:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8dfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a7 expref: 22 pid: 6511 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.890446:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8dfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a7 expref: 22 pid: 6511 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.890467:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faba00/0xd18a1efeeddb8dfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9a7 expref: 22 pid: 6511 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.890483:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:0.0:1787574510.890489:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8e5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ca expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.890500:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.890508:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.890515:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.890561:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574510.890620:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:2404:x1874407323708544:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 209us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574510.890629:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 105 00010000:00010000:2.0:1787574510.891029:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.891049:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.891221:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.891282:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ec5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9e6 expref: 21 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.891289:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.891317:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9e6 expref: 21 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.891330:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9e6 expref: 21 pid: 11515 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574510.891341:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1874407346832896:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574510.891399:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebe180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574510.898049:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1874407346832896:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574510.898079:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574510.907580:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574510.907676:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323708672 00000100:00100000:0.0:1787574510.907686:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323708672 00010000:00010000:0.0:1787574510.907739:0:6494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9e6 expref: 22 pid: 11515 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574510.907780:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 106 00000100:00100000:0.0:1787574510.907790:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:2405:x1874407323708672:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574510.907804:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574510.907812:0:6494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9e6 expref: 22 pid: 11515 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.907825:0:6494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9e6 expref: 22 pid: 11515 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.907847:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb8ec5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9e6 expref: 22 pid: 11515 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.907864:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:0.0:1787574510.907890:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.907900:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.907918:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.907963:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574510.908026:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:2405:x1874407323708672:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 237us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574510.908034:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 106 00010000:00010000:2.0:1787574510.908387:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.908394:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787574510.908497:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1787574510.908606:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1787574510.908637:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1787574510.908721:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6511:1874407346833024:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787574510.908766:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574510.908841:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574510.916629:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346833024 00000100:00100000:3.0:1787574510.916645:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346833024 00000100:00100000:3.0:1787574510.916760:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787574510.916771:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6511:x1874407346833024:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787574510.916932:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6511:x1874407346833024:12345-0@lo:1000:mdt00_002.0 Request processed in 163us (8165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574510.916940:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787574510.917015:0:6511:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1787574510.917021:0:6511:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1787574510.917044:0:6511:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca5045aa300, transno 4294967322 00000100:00100000:0.0:1787574510.917070:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6511:1874407346833024:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787574510.917216:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1787574510.917349:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6511:1874407346833152:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787574510.917389:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574510.918211:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574510.918403:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346833152 00000100:00100000:2.0:1787574510.918411:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346833152 00000100:00100000:2.0:1787574510.918447:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787574510.918455:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6511:x1874407346833152:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787574510.918592:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6511:x1874407346833152:12345-0@lo:1000:mdt00_002.0 Request processed in 138us (1202us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787574510.918599:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787574510.918676:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6511:1874407346833152:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787574510.918729:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.918738:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.918745:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.918765:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574510.918770:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.918778:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.918794:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:0.0:1787574510.918797:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574510.918801:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.918808:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab600/0xd18a1efeeddb8f12 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.918836:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.918841:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.918847:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.920675:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574510.920683:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.920694:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.920740:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:0.0:1787574510.920743:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574510.920752:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8e5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ca expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.920764:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8e5c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ca expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.920774:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8e5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ca expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.920814:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8e5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ca expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574510.920829:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1874407346833280:192.168.202.40@tcp:105: 00000100:00100000:0.0:1787574510.921315:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574510.926874:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1874407346833280:192.168.202.40@tcp:105: 00010000:00010000:0.0:1787574510.926915:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.926926:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb8e55 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.926985:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8f19 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927001:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8f19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927025:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8f19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927035:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8f19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927041:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8f19 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927048:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8f19 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927054:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574510.927058:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8f19 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927065:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8f19 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927076:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:0.0:1787574510.927079:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574510.927082:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8f19 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927088:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb8f19 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927098:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927104:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927129:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927135:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574510.927138:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927144:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927152:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:0.0:1787574510.927155:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574510.927158:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574510.927163:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19800/0xd18a1efeeddb8f0b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574510.927373:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:12494:x1874407323708416:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 55682us (56196us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787574510.927384:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 247 00000020:00080000:0.0:1787574510.927390:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787574510.927667:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574510.927673:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574510.928167:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787574510.928177:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787574510.930656:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574510.930745:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323708800 00000100:00100000:1.0:1787574510.930756:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323708800 00000100:00100000:1.0:1787574510.930808:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:1.0:1787574510.930820:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:12492:x1874407323708800:12345-192.168.202.40@tcp:49:lfs.0 00000100:00100000:1.0:1787574510.930980:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:12492:x1874407323708800:12345-192.168.202.40@tcp:49:lfs.0 Request processed in 161us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574510.930988:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:1.0:1787574510.937442:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574510.937607:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574510.937695:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323709312 00000100:00100000:3.0:1787574510.937716:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323709312 00000100:00100000:3.0:1787574510.937775:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 248 00000100:00100000:3.0:1787574510.937786:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:12492:x1874407323709312:12345-192.168.202.40@tcp:58:lfs.0 00000040:00080000:3.0:1787574510.938189:0:8610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787574510.938396:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:12492:x1874407323709312:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 611us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574510.938404:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 248 00000100:00100000:2.0:1787574510.940446:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323709056 00000100:00100000:2.0:1787574510.940459:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323709056 00000100:00100000:2.0:1787574510.940517:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:2.0:1787574510.940527:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518c36850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+24:12494:x1874407323709056:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787574510.940787:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787574510.940816:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:2.0:1787574510.940850:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8f20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.941271:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.941284:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.941293:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8f20 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.941315:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8f20 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.941321:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8f20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574510.941335:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787574510.941424:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518c36850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+26:12494:x1874407323709056:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 896us (3992us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787574510.941432:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000020:00080000:2.0:1787574510.941437:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787574510.941557:0:13730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574510.941564:0:13730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8f20 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.941580:0:13730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faae00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574510.941584:0:13730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8f20 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.941592:0:13730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8f20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.941604:0:13730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:3.0:1787574510.941612:0:13730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787574510.941618:0:13730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8f20 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.941623:0:13730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faae00/0xd18a1efeeddb8f20 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.941636:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574510.941637:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574510.941639:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574510.987894:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574510.988204:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323709440 00000100:00100000:3.0:1787574510.988217:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323709440 00000100:00100000:3.0:1787574510.988318:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 249 00000100:00100000:3.0:1787574510.988329:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+26:12496:x1874407323709440:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574510.988365:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574510.988386:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9ba02 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.988450:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8f2e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.988483:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8f2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.988494:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8f2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.988511:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.988519:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.988526:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.988599:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.988608:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9c3 expref: 27 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.988617:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.988647:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9c3 expref: 27 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574510.988844:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9c3 expref: 27 pid: 11515 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574510.988882:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346833408:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574510.988979:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574510.995287:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574510.995366:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323709696 00000100:00100000:3.0:1787574510.995370:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1874407346833408:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574510.995374:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323709696 00010000:00010000:3.0:1787574510.995396:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574510.995429:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:2.0:1787574510.995438:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+28:6177:x1874407323709696:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787574510.995639:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:6177:x1874407323709696:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 201us (361us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787574510.995647:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:1.0:1787574510.998791:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574510.999648:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323709824 00000100:00100000:3.0:1787574510.999735:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323709824 00010000:00010000:2.0:1787574510.999898:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9c3 expref: 29 pid: 11515 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574510.999998:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:2.0:1787574511.000009:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:2405:x1874407323709824:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574511.000024:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574511.000040:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9c3 expref: 29 pid: 11515 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574511.000075:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9c3 expref: 29 pid: 11515 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574511.000099:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab200/0xd18a1efeeddb8e47 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9c3 expref: 29 pid: 11515 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574511.000116:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574511.000122:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574511.000131:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574511.000138:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574511.000169:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574511.000267:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+28:2405:x1874407323709824:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 229us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574511.000275:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 107 00010000:00010000:3.0:1787574511.000596:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000605:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574511.000668:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787574511.000673:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574511.000693:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000706:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000715:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8f2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000721:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8f2e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000727:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8f2e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000740:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574511.000744:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8f2e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000752:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8f2e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000762:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574511.000765:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574511.000768:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8f2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000774:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb800/0xd18a1efeeddb8f2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000785:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000791:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000797:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000802:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574511.000804:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000810:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000828:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ca5186ca900) 00010000:00010000:3.0:1787574511.000831:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574511.000834:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000841:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000875:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba02 expref: 28 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000889:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba02 expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574511.000897:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:3.0:1787574511.000900:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574511.000902:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb600, rc 0) 00000100:00100000:3.0:1787574511.000947:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:12496:x1874407323709440:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 12620us (13064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574511.000965:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 249 00010000:00010000:2.0:1787574511.282875:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787574511.730213:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787574511.866889:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574511.866911:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346833536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574511.866997:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574511.867068:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346833536 00000100:00100000:0.0:1787574511.867076:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346833536 00000100:00100000:0.0:1787574511.867142:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787574511.867160:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346833536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574511.867194:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787574511.867257:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346833536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574511.867264:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787574511.867304:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346833536:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787574511.953712:0:14707:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787574511.953721:0:14707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574511.953750:0:14707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787574511.953760:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787574511.990460:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787574511.990469:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787574511.990516:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787574511.990523:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787574511.990649:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045aad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346833664:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787574511.990750:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52053a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574512.006234:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045aad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874407346833664:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787574512.019664:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574512.019992:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323709952 00000100:00100000:2.0:1787574512.020002:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323709952 00000100:00100000:2.0:1787574512.020076:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 250 00000100:00100000:2.0:1787574512.020088:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:12509:x1874407323709952:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787574512.020121:0:6511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787574512.020237:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:12509:x1874407323709952:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 150us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574512.020278:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 250 00000100:00080000:1.0:1787574512.020477:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574512.027297:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574512.031543:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323710208 00000100:00100000:2.0:1787574512.031557:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323710208 00000100:00100000:2.0:1787574512.031630:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 251 00000100:00100000:2.0:1787574512.031642:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+27:12509:x1874407323710208:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574512.031663:0:8610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574512.031753:0:8610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8f43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9ba09 expref: -99 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574512.034198:0:8610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8f4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574512.034221:0:8610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574512.034232:0:8610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8610 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574512.034265:0:8610:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787574512.034406:0:8610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab800/0xd18a1efeeddb8f43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba09 expref: 30 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574512.034426:0:8610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8f4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba09 expref: 29 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574512.034435:0:8610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574512.034439:0:8610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574512.034442:0:8610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab400, rc 0) 00000100:00100000:2.0:1787574512.035640:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:12509:x1874407323710208:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 3992us (8345us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787574512.035652:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 251 00000100:00100000:3.0:1787574512.039802:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574512.039891:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323710336 00000100:00100000:2.0:1787574512.039901:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323710336 00000100:00100000:2.0:1787574512.040001:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:2.0:1787574512.040013:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:2404:x1874407323710336:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574512.040038:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574512.040064:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab400/0xd18a1efeeddb8f4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba09 expref: 29 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574512.040084:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:2.0:1787574512.040089:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574512.040146:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+28:2404:x1874407323710336:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 135us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574512.040154:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1787574512.050627:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574512.057141:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323710592 00000100:00100000:2.0:1787574512.057153:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323710592 00000100:00100000:1.0:1787574512.057428:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 252 00000100:00100000:1.0:1787574512.057439:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+28:12509:x1874407323710592:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787574512.057521:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8f58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574512.057538:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8f58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574512.057549:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8f58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574512.057681:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8f58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574512.057689:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8f58 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574512.057696:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8f58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574512.057702:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574512.057707:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8f58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574512.057715:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8f58 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574512.057727:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:1.0:1787574512.057735:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787574512.057740:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8f58 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574512.057746:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb8f58 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574512.057858:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:12509:x1874407323710592:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 420us (7240us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787574512.057866:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 252 00000040:00080000:2.0:1787574512.058581:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787574512.058587:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787574512.059718:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787574512.059730:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787574512.065187:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574512.067588:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323710848 00000100:00100000:2.0:1787574512.067604:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323710848 00000100:00100000:2.0:1787574512.067673:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:2.0:1787574512.067684:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+29:12509:x1874407323710848:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787574512.067915:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:12509:x1874407323710848:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 232us (2739us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787574512.067932:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00010000:00010000:2.0:1787574512.305475:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574512.369619:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346834048:0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.369689:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574512.369749:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346834560:0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.369774:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574512.369797:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346835072:0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.369817:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574512.369843:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787574512.369849:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346833920:0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.369882:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574512.369900:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346834432:0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.369920:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574512.369937:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346834944:0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.369966:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574512.370001:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346834048 00000100:00100000:2.0:1787574512.370008:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346834048 00000100:00100000:2.0:1787574512.370063:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346833920 00000100:00100000:2.0:1787574512.370067:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346833920 00000100:00100000:2.0:1787574512.370079:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346834432 00000100:00100000:2.0:1787574512.370082:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346834432 00000100:00100000:2.0:1787574512.370105:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346834944 00000100:00100000:2.0:1787574512.370108:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346834944 00000100:00100000:2.0:1787574512.370125:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787574512.370133:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346834048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.370189:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346834048:12345-0@lo:400:kworker.0 Request processed in 56us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574512.370211:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787574512.370231:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787574512.370236:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346833920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.370295:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346833920:12345-0@lo:400:kworker.0 Request processed in 59us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574512.370301:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787574512.370313:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787574512.370319:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346834432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.370344:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346834432:12345-0@lo:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574512.370349:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787574512.370360:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1787574512.370365:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346834944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.370391:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346834944:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574512.370396:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:2.0:1787574512.370414:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787574512.370444:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346833920:0@lo:400:kworker.0 00010000:00080000:2.0:1787574512.370456:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403746680 x1874407346834432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574512.370466:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346834432:0@lo:400:kworker.0 00010000:00080000:2.0:1787574512.370473:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403746d80 x1874407346834944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574512.370480:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346834944:0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.370499:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346834048:0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.370846:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346834176:0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.370958:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574512.370990:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346834688:0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371014:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574512.371036:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346835200:0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371055:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574512.371076:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787574512.371082:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346833792:0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371106:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574512.371129:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346834304:0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371147:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574512.371163:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346834816:0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371183:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574512.371198:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346835328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574512.371218:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574512.371265:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346834560 00000100:00100000:3.0:1787574512.371270:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346834560 00000100:00100000:3.0:1787574512.371304:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346835072 00000100:00100000:3.0:1787574512.371306:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346835072 00000100:00100000:3.0:1787574512.371320:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346834688 00000100:00100000:3.0:1787574512.371323:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346834688 00000100:00100000:3.0:1787574512.371332:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346835200 00000100:00100000:3.0:1787574512.371334:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346835200 00000100:00100000:3.0:1787574512.371346:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787574512.371352:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346834560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371401:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346834560:12345-0@lo:400:kworker.0 Request processed in 49us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574512.371408:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787574512.371423:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787574512.371429:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346835072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371456:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346835072:12345-0@lo:400:kworker.0 Request processed in 28us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574512.371474:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787574512.371485:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787574512.371491:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346834688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371520:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346834688:12345-0@lo:400:kworker.0 Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574512.371526:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787574512.371536:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787574512.371542:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346835200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371568:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346835200:12345-0@lo:400:kworker.0 Request processed in 27us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574512.371573:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787574512.371590:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346834304 00000100:00100000:3.0:1787574512.371593:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346834304 00000100:00100000:3.0:1787574512.371610:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346834816 00000100:00100000:3.0:1787574512.371612:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346834816 00000100:00100000:3.0:1787574512.371622:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787574512.371627:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346834304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371653:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346834304:12345-0@lo:400:kworker.0 Request processed in 25us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574512.371667:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787574512.371677:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1787574512.371683:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346834816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371710:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346834816:12345-0@lo:400:kworker.0 Request processed in 28us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574512.371716:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1787574512.371742:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346833792 00000100:00100000:3.0:1787574512.371746:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346833792 00000100:00100000:3.0:1787574512.371769:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1787574512.371775:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346833792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371801:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346833792:12345-0@lo:400:kworker.0 Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574512.371807:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1787574512.371832:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346835328 00000100:00100000:3.0:1787574512.371835:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346835328 00000100:00100000:3.0:1787574512.371855:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787574512.371861:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346835328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574512.371881:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574512.371909:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346835328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574512.371914:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787574512.371958:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346833792:0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371971:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346834304:0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371979:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346834816:0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.371998:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1787574512.372003:0:3634:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1787574512.372029:0:3634:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca4040a4700, transno 4294967308 00000004:00080000:3.0:1787574512.372038:0:3634:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1787574512.372047:0:3634:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca404131180, transno 4294967311 00000100:00100000:3.0:1787574512.372056:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346835328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574512.372069:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346834688:0@lo:400:kworker.0 00000100:00100000:3.0:1787574512.372078:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346835200:0@lo:400:kworker.0 00000100:00100000:0.0:1787574512.372468:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346834176 00000100:00100000:0.0:1787574512.372474:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346834176 00000100:00100000:0.0:1787574512.372515:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787574512.372523:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346834176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574512.372574:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346834176:12345-0@lo:400:kworker.0 Request processed in 52us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574512.372580:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787574512.372610:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346834176:0@lo:400:kworker.0 00000100:00080000:2.0:1787574512.373086:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574512.373091:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574512.373094:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574512.373119:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346834560:0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.373131:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346835072:0@lo:400:kworker.0 00000100:00100000:2.0:1787574512.374281:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346835584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574512.374334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574512.374376:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574512.374382:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346835456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574512.374406:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574512.374437:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346835456 00000100:00100000:2.0:1787574512.374443:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346835456 00000100:00100000:0.0:1787574512.374552:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346835584 00000100:00100000:0.0:1787574512.374557:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346835584 00000100:00100000:0.0:1787574512.374592:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787574512.374600:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346835584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574512.374620:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574512.374665:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346835584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574512.374671:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787574512.375107:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787574512.375116:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346835456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574512.375143:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787574512.375179:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346835456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574512.375185:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787574512.375608:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346835456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574512.375627:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346835584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574512.393377:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574512.393432:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574512.393543:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574512.393599:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574512.393633:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323711104 00000100:00100000:3.0:1787574512.393642:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323711104 00000100:00100000:3.0:1787574512.393701:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323711488 00000100:00100000:3.0:1787574512.393705:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323711488 00000100:00100000:3.0:1787574512.393728:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 398 00000100:00100000:3.0:1787574512.393738:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323711104:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574512.393813:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323711104:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 75us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574512.393821:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 398 00000100:00100000:3.0:1787574512.393839:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 399 00000100:00100000:1.0:1787574512.393969:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323711232 00000100:00100000:1.0:1787574512.393974:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323711232 00000100:00100000:1.0:1787574512.394007:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:1.0:1787574512.394080:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323711232:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574512.394111:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323711232:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 98us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574512.394118:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:2.0:1787574512.394737:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323710976 00000100:00100000:2.0:1787574512.394744:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323710976 00000100:00100000:2.0:1787574512.394786:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 404 00000100:00100000:2.0:1787574512.394795:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323710976:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574512.394839:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323710976:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 47us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574512.394910:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 404 00000100:00080000:2.0:1787574512.394952:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574512.394958:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574512.394960:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574512.397975:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323711488:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574512.399309:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574512.399352:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574512.399455:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323711616 00000100:00100000:1.0:1787574512.399698:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323711616 00000100:00100000:1.0:1787574512.399774:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 400 00000100:00100000:1.0:1787574512.399785:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323711616:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574512.399850:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323711616:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 67us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574512.399972:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323711488:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 6116us (6372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574512.399981:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 399 00000100:00100000:2.0:1787574512.400716:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323711360 00000100:00100000:2.0:1787574512.400723:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323711360 00000100:00100000:2.0:1787574512.400771:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:2.0:1787574512.400779:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323711360:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574512.400819:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323711360:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 41us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574512.400825:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:1.0:1787574512.400987:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 400 00000100:00080000:0.0:1787574512.401108:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574512.401129:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787574513.331361:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574514.060616:0:14758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787574514.060626:0:14758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787574514.060661:0:14758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787574514.060666:0:14758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787574514.241362:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574514.241453:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323711872 00000100:00100000:3.0:1787574514.241461:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323711872 00000100:00100000:3.0:1787574514.241568:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 253 00000100:00100000:3.0:1787574514.241581:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+30:12529:x1874407323711872:12345-192.168.202.40@tcp:101:lfs.0 00000100:00080000:0.0:1787574514.241586:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787574514.241604:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574514.241631:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9ba10 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.241751:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.241764:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.241773:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574514.241782:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787574514.241878:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba10 expref: 33 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.241897:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba10 expref: 32 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.241917:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:3.0:1787574514.241919:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787574514.241922:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb400, rc 0) 00000100:00100000:3.0:1787574514.241977:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:12529:x1874407323711872:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 400us (622us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787574514.241984:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 253 00000100:00100000:0.0:1787574514.250210:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574514.250281:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323712000 00000100:00100000:3.0:1787574514.250293:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323712000 00000100:00100000:3.0:1787574514.250391:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:3.0:1787574514.250400:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:12529:x1874407323712000:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1787574514.250460:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.250475:0:11515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.250483:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.250512:0:11515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.250518:0:11515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.250525:0:11515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.250542:0:11515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fbe00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574514.250563:0:11515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.250571:0:11515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.250583:0:11515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:3.0:1787574514.250587:0:11515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574514.250592:0:11515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574514.250598:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fbe00/0xd18a1efeeddb8f74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574514.250690:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+32:12529:x1874407323712000:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 290us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574514.250698:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:0.0:1787574514.340570:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574514.340662:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323712128 00000100:00100000:1.0:1787574514.340671:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323712128 00000100:00100000:1.0:1787574514.340784:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:1.0:1787574514.340809:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2403:x1874407323712128:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:1.0:1787574514.340827:0:8619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574514.340856:0:8619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb8f7b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9ba17 expref: -99 pid: 8619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787574514.340880:0:8619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8c38ed, atime: 0x6a8c38ed, ctime: 0x6a8c38ed, blocks: 0x8 00010000:00010000:1.0:1787574514.340898:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787574514.340902:0:8619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574514.340911:0:8619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb8f7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba17 expref: 8 pid: 8619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574514.340939:0:8619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb8f7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba17 expref: 8 pid: 8619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574514.340952:0:8619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19600, rc 0) 00000100:00100000:1.0:1787574514.341015:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2403:x1874407323712128:12345-192.168.202.40@tcp:101:cat.0 Request processed in 207us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574514.341022:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00080000:0.0:1787574514.341750:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574514.346740:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574514.346909:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323712256 00000100:00100000:1.0:1787574514.346919:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323712256 00002000:00100000:1.0:1787574514.346988:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9ca403746680 x1874407323712256/t0(0) o3->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:285/0 lens 488/0 e 0 to 0 dl 1787574525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787574514.347000:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca403746680 with x1874407323712256 ext(0->4095) 00002000:00010000:1.0:1787574514.347005:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca403746680 00000100:00100000:1.0:1787574514.347066:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:1.0:1787574514.347076:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2402:x1874407323712256:12345-192.168.202.40@tcp:3:cat.0 00000100:00100000:1.0:1787574514.347271:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+8:2402:x1874407323712256:12345-192.168.202.40@tcp:3:cat.0 Request processed in 196us (541us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787574514.347279:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00002000:00100000:1.0:1787574514.347287:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9ca403746680 x1874407323712256/t0(0) o3->1aeb3668-c6f6-4338-ab9b-0a7c9161b421@192.168.202.40@tcp:285/0 lens 488/4536 e 0 to 0 dl 1787574525 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787574514.347296:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca403746680 with x1874407323712256 ext(0->4095) 00002000:00010000:1.0:1787574514.347810:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca403746680 00010000:00010000:3.0:1787574514.353484:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574515.377740:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787574515.444194:0:8616:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 454626951661ns, next at 455626948995ns, rc = 0 00000100:00100000:0.0:1787574515.444228:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346835712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574515.444327:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574515.444408:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346835712 00000100:00100000:0.0:1787574515.444415:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346835712 00000100:00100000:0.0:1787574515.444462:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787574515.444474:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346835712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574515.444500:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787574515.444543:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346835712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574515.444550:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1787574515.444570:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574515.444622:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346835712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574515.446428:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346835840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574515.446495:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574515.446548:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346835840 00000100:00100000:0.0:1787574515.446554:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346835840 00000100:00100000:0.0:1787574515.446615:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787574515.446625:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346835840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574515.446643:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787574515.446683:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346835840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574515.446704:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1787574515.446724:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574515.446754:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346835840:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787574516.412583:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574516.981949:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574516.981974:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346835968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574516.982047:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574516.982840:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346835968 00000100:00100000:2.0:1787574516.982858:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346835968 00000100:00100000:2.0:1787574516.982917:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787574516.982926:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346835968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574516.982961:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787574516.983027:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346835968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574516.983034:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787574516.983211:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346835968:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1787574516.984844:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1787574516.984866:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000004:00080000:1.0:1787574516.995010:0:6488:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:3.0:1787574516.995206:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574516.995225:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346836096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787574516.995326:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574516.995408:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346836096 00000100:00100000:3.0:1787574516.995417:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346836096 00000100:00100000:3.0:1787574516.995475:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787574516.995484:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346836096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787574516.995637:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787574516.995641:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787574509 -> 1787574509 00002000:00010000:3.0:1787574516.995644:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1787574509 -> 1787574509 00002000:00010000:3.0:1787574516.995646:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787574509 -> 1787574509 00002000:00010000:3.0:1787574516.995648:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787574516.995686:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346836096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (360us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787574516.995693:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787574516.995727:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787574516.995732:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787574516.995754:0:3636:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ca53bf8ea00 x1874407346836096/t4294967325(4294967325) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787574532 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787574516.995764:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca53bf8ea00/2, rc 0, transno 4294967325 00000100:00100000:3.0:1787574516.995769:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346836096:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1787574516.997268:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1787574516.997311:0:6488:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ca509a359c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787574516.997317:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca4040d9000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ca4033ead80 00000020:00080000:1.0:1787574516.997320:0:6488:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca4040d9900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ca502fbc200 00000020:00080000:1.0:1787574516.997341:0:6488:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1787574516.999157:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787574516.999290:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1787574517.000513:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574517.000545:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574517.000553:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574517.000559:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574517.000564:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574517.000572:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574517.000592:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ca535d9de00) 00010000:00010000:2.0:1787574517.000595:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574517.000600:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574517.000606:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb8ef6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574517.426420:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574517.489531:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346836224:0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.489602:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574517.489644:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346836736:0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.489670:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574517.489685:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346837248:0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.489704:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574517.489740:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787574517.489745:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346836352:0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.489781:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574517.489797:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346836864:0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.489828:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574517.489966:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346836224 00000100:00100000:2.0:1787574517.489974:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346836224 00000100:00100000:2.0:1787574517.490017:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1787574517.490027:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346836224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490073:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346836224:12345-0@lo:400:kworker.0 Request processed in 46us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574517.490080:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1787574517.490128:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346836480:0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490159:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574517.490176:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346836992:0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490197:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574517.490214:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346837504:0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490232:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574517.490274:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787574517.490280:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346836608:0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490346:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574517.490365:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346837120:0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490386:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574517.490396:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346837632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574517.490415:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574517.490444:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346836736 00000100:00100000:2.0:1787574517.490448:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346836736 00000100:00100000:2.0:1787574517.490478:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346837248 00000100:00100000:2.0:1787574517.490481:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346837248 00000100:00100000:2.0:1787574517.490490:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346836352 00000100:00100000:2.0:1787574517.490492:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346836352 00000100:00100000:2.0:1787574517.490501:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346836864 00000100:00100000:2.0:1787574517.490504:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346836864 00000100:00100000:2.0:1787574517.490514:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346836480 00000100:00100000:2.0:1787574517.490516:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346836480 00000100:00100000:2.0:1787574517.490524:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346837120 00000100:00100000:2.0:1787574517.490526:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346837120 00000100:00100000:2.0:1787574517.490539:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1787574517.490546:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346836736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490580:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346836736:12345-0@lo:400:kworker.0 Request processed in 34us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574517.490596:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1787574517.490626:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1787574517.490632:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346837248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490662:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346837248:12345-0@lo:400:kworker.0 Request processed in 31us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574517.490667:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1787574517.490677:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1787574517.490682:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346836352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490705:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346836352:12345-0@lo:400:kworker.0 Request processed in 23us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574517.490710:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1787574517.490721:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1787574517.490727:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346836864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490750:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346836864:12345-0@lo:400:kworker.0 Request processed in 24us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574517.490756:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1787574517.490767:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1787574517.490773:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346836480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490799:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346836480:12345-0@lo:400:kworker.0 Request processed in 26us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574517.490804:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1787574517.490813:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1787574517.490819:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346837120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.490843:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346837120:12345-0@lo:400:kworker.0 Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574517.491028:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346837376:0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.491055:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574517.491086:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346836224:0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.491099:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346836736:0@lo:400:kworker.0 00010000:00080000:3.0:1787574517.491110:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8fb80 x1874407346837248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574517.491121:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346837248:0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.491142:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346836352:0@lo:400:kworker.0 00010000:00080000:3.0:1787574517.491152:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8c000 x1874407346836864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574517.491159:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346836864:0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.491188:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346836992 00000100:00100000:3.0:1787574517.491192:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346836992 00000100:00100000:3.0:1787574517.491219:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346837504 00000100:00100000:3.0:1787574517.491222:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346837504 00000100:00100000:3.0:1787574517.491233:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346837376 00000100:00100000:3.0:1787574517.491235:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346837376 00000100:00100000:3.0:1787574517.491266:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787574517.491272:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346836992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.491302:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346836992:12345-0@lo:400:kworker.0 Request processed in 31us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574517.491318:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787574517.491332:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787574517.491338:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346837504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.491365:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346837504:12345-0@lo:400:kworker.0 Request processed in 27us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574517.491371:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787574517.491382:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787574517.491387:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346837376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.491415:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346837376:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574517.491420:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787574517.491448:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346837376:0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.491512:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1787574517.491538:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346836608 00000100:00100000:2.0:1787574517.491542:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346836608 00000100:00100000:2.0:1787574517.491573:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787574517.491580:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346836608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.491614:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346836608:12345-0@lo:400:kworker.0 Request processed in 34us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574517.491620:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787574517.491636:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346837632 00000100:00100000:2.0:1787574517.491640:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346837632 00000100:00100000:2.0:1787574517.491662:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787574517.491668:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346837632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574517.491689:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574517.491718:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346837632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574517.491724:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:2.0:1787574517.491739:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574517.491743:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574517.491746:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574517.491748:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574517.492193:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346836608:0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.492205:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346837120:0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.492219:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346837632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574517.492229:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346836480:0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.492265:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346836992:0@lo:400:kworker.0 00000100:00100000:2.0:1787574517.492288:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346837504:0@lo:400:kworker.0 00000100:00100000:3.0:1787574517.492479:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346837760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574517.492515:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574517.492542:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574517.492548:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346837888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574517.492575:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574517.492650:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346837760 00000100:00100000:0.0:1787574517.492656:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346837760 00000100:00100000:0.0:1787574517.492683:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787574517.492690:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346837760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574517.492703:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574517.492750:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346837760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574517.492756:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787574517.494562:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346837760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574517.495173:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346837888 00000100:00100000:1.0:1787574517.495181:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346837888 00000100:00100000:1.0:1787574517.495234:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787574517.495265:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51ea41050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346837888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574517.495297:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787574517.495391:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51ea41050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346837888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (2814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574517.495398:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787574517.495879:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346837888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574517.516563:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574517.516655:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574517.516692:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574517.516714:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574517.516732:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574517.516747:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574517.516783:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574517.516809:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323712896 00000100:00100000:3.0:1787574517.516819:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323712896 00000100:00100000:3.0:1787574517.516873:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323712768 00000100:00100000:3.0:1787574517.516877:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323712768 00000100:00100000:3.0:1787574517.516915:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:3.0:1787574517.516925:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323712896:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574517.516998:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323712896:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 73us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574517.517006:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:3.0:1787574517.517022:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:3.0:1787574517.517029:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323712768:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574517.517054:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323712768:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574517.517060:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:3.0:1787574517.517077:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323712640 00000100:00100000:3.0:1787574517.517081:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323712640 00000100:00100000:3.0:1787574517.517102:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323713152 00000100:00100000:3.0:1787574517.517104:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323713152 00000100:00100000:3.0:1787574517.517115:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323712512 00000100:00100000:3.0:1787574517.517117:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323712512 00000100:00100000:3.0:1787574517.517127:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323713024 00000100:00100000:3.0:1787574517.517129:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323713024 00000100:00100000:3.0:1787574517.517143:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 407 00000100:00100000:3.0:1787574517.517148:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323712640:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574517.517174:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323712640:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574517.517189:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 407 00000100:00100000:3.0:1787574517.517201:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 408 00000100:00100000:3.0:1787574517.517207:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323713152:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574517.517229:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323713152:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574517.517235:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 408 00000100:00100000:3.0:1787574517.517272:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 409 00000100:00100000:3.0:1787574517.517280:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:2405:x1874407323712512:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574517.517306:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:2405:x1874407323712512:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574517.517312:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 409 00000100:00100000:3.0:1787574517.517324:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 410 00000100:00100000:3.0:1787574517.517330:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323713024:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574517.517352:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323713024:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574517.517358:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 410 00000100:00080000:3.0:1787574517.517377:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574517.517381:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574517.517383:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574517.517386:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574517.517627:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323712384 00000100:00100000:0.0:1787574517.517632:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323712384 00000100:00100000:0.0:1787574517.517668:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 406 00000100:00100000:0.0:1787574517.517676:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323712384:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574517.517715:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323712384:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 40us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574517.517722:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 406 00010000:00010000:3.0:1787574518.451352:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574519.473731:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574520.499490:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574520.565179:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574520.565204:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346838016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574520.565293:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574520.565354:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346838016 00000100:00100000:1.0:1787574520.565370:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346838016 00000100:00100000:1.0:1787574520.565431:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787574520.565442:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346838016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574520.565472:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787574520.565522:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346838016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574520.565529:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787574520.565578:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346838016:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787574520.568294:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574520.568421:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346838144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574520.568493:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574520.570508:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346838144 00000100:00100000:2.0:1787574520.570520:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346838144 00000100:00100000:2.0:1787574520.570585:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787574520.570594:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346838144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574520.570617:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787574520.570688:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346838144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574520.570695:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787574520.570746:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346838144:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787574520.574026:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574521.067371:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574521.068127:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323713280 00000100:00100000:2.0:1787574521.068139:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323713280 00000100:00100000:2.0:1787574521.068222:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 255 00000100:00100000:2.0:1787574521.068233:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:12181:x1874407323713280:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1787574521.068763:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574521.068930:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:12181:x1874407323713280:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 165us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574521.068939:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 255 00000100:00100000:1.0:1787574521.072734:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574521.073158:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323713408 00000100:00100000:2.0:1787574521.073169:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323713408 00000100:00100000:2.0:1787574521.073276:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 256 00000100:00100000:2.0:1787574521.073287:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:12181:x1874407323713408:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787574521.073573:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:12181:x1874407323713408:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 286us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574521.073594:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 256 00000100:00080000:1.0:1787574521.073666:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574521.089740:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574521.090283:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323713664 00000100:00100000:1.0:1787574521.090294:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323713664 00000100:00100000:1.0:1787574521.090358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:1.0:1787574521.090368:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:12181:x1874407323713664:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787574521.090616:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:12181:x1874407323713664:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 249us (898us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787574521.090623:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000040:00080000:2.0:1787574521.265458:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787574521.265466:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787574521.265558:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1787574521.265566:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787574521.444273:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574521.444386:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323713792 00000100:00100000:1.0:1787574521.444397:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323713792 00000100:00100000:1.0:1787574521.444539:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 257 00000100:00100000:1.0:1787574521.444551:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+5:12987:x1874407323713792:12345-192.168.202.40@tcp:101:lsof.0 00010000:00010000:1.0:1787574521.444572:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574521.444609:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8f82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9ba1e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574521.444675:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8f89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574521.444700:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8f89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574521.444716:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8f89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574521.444773:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787574521.444946:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574521.444973:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8f89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574521.444998:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb8f82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba1e expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574521.445017:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8f89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba1e expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574521.445026:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a50d00) 00010000:00010000:1.0:1787574521.445029:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787574521.445034:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e18600, rc 0) 00000100:00100000:1.0:1787574521.445100:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0874c266-15f3-4d8d-abed-9d908d92af46+6:12987:x1874407323713792:12345-192.168.202.40@tcp:101:lsof.0 Request processed in 551us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574521.445107:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 257 00000100:00080000:2.0:1787574521.447474:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787574521.521858:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787574521.970063:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787574522.098668:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574522.098691:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346838272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574522.098760:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574522.098918:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346838272 00000100:00100000:2.0:1787574522.098926:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346838272 00000100:00100000:2.0:1787574522.098977:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787574522.098988:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346838272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574522.099021:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787574522.099076:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346838272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574522.099083:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787574522.099528:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346838272:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787574522.545517:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574522.609970:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346838528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574522.610045:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574522.610299:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346838528 00000100:00100000:0.0:1787574522.610307:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346838528 00000100:00100000:0.0:1787574522.610367:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787574522.610379:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346838528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574522.610407:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574522.610454:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346838528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574522.610461:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787574522.610504:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346838528:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787574522.610569:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574522.611730:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574522.611748:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346838400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574522.611796:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574522.612008:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346838400 00000100:00100000:2.0:1787574522.612014:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346838400 00000100:00100000:2.0:1787574522.612069:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787574522.612077:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346838400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574522.612093:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574522.612132:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346838400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574522.612139:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787574522.612277:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346838656:0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.612315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574522.612338:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346839168:0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.612363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574522.612382:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346839680:0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.612402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574522.612422:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787574522.612427:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346839040:0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.612451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574522.612467:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346839552:0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.612489:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574522.612513:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346838656 00000100:00100000:2.0:1787574522.612517:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346838656 00000100:00100000:2.0:1787574522.612545:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1787574522.612551:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346838656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.612586:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346838656:12345-0@lo:400:kworker.0 Request processed in 35us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574522.612593:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1787574522.612621:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346839040 00000100:00100000:2.0:1787574522.612625:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346839040 00000100:00100000:2.0:1787574522.612663:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787574522.612670:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346839040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.612702:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346839040:12345-0@lo:400:kworker.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574522.612707:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787574522.612729:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346839168 00000100:00100000:2.0:1787574522.612732:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346839168 00000100:00100000:2.0:1787574522.612987:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346839680 00000100:00100000:2.0:1787574522.612991:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346839680 00000100:00100000:2.0:1787574522.613009:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1787574522.613015:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346839168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.613047:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346839168:12345-0@lo:400:kworker.0 Request processed in 32us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574522.613053:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1787574522.613066:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1787574522.613073:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346839680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.613101:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346839680:12345-0@lo:400:kworker.0 Request processed in 29us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574522.613107:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1787574522.613143:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346839040:0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.613154:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346838656:0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.613163:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346839168:0@lo:400:kworker.0 00000100:00100000:2.0:1787574522.613171:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346839680:0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.615359:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346839552 00000100:00100000:3.0:1787574522.615370:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346839552 00000100:00100000:3.0:1787574522.615417:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787574522.615425:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346839552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.615492:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346839552:12345-0@lo:400:kworker.0 Request processed in 68us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574522.615498:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787574522.615526:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346838784:0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.615556:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574522.615575:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346839296:0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.615590:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574522.615603:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346839808:0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.615618:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574522.615663:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346838400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574522.615686:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787574522.615693:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346838912:0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.615713:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574522.615728:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346839424:0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.615811:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574522.615834:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346839424 00000100:00100000:3.0:1787574522.615837:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346839424 00000100:00100000:3.0:1787574522.615882:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787574522.615887:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346839424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.615916:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346839424:12345-0@lo:400:kworker.0 Request processed in 29us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574522.615922:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787574522.615949:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346838784 00000100:00100000:3.0:1787574522.615953:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346838784 00000100:00100000:3.0:1787574522.615969:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346839296 00000100:00100000:3.0:1787574522.615971:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346839296 00000100:00100000:3.0:1787574522.615982:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346839808 00000100:00100000:3.0:1787574522.615984:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346839808 00000100:00100000:3.0:1787574522.615992:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346838912 00000100:00100000:3.0:1787574522.615994:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346838912 00000100:00100000:3.0:1787574522.616004:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1787574522.616009:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346838784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.616033:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346838784:12345-0@lo:400:kworker.0 Request processed in 24us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574522.616039:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1787574522.616048:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1787574522.616053:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346839296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.616071:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346839296:12345-0@lo:400:kworker.0 Request processed in 18us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574522.616076:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1787574522.616084:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1787574522.616088:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346839808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.616105:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346839808:12345-0@lo:400:kworker.0 Request processed in 17us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574522.616118:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1787574522.616127:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1787574522.616132:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346838912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.616151:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346838912:12345-0@lo:400:kworker.0 Request processed in 20us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574522.616157:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00080000:3.0:1787574522.616170:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574522.616174:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574522.616176:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574522.616178:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574522.616395:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346839552:0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.616416:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346838912:0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.616423:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346839424:0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.616431:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346838784:0@lo:400:kworker.0 00010000:00080000:3.0:1787574522.616441:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4041c6680 x1874407346839296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574522.616451:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346839296:0@lo:400:kworker.0 00010000:00080000:3.0:1787574522.616459:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4f7100 x1874407346839808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574522.616466:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346839808:0@lo:400:kworker.0 00000100:00100000:3.0:1787574522.617053:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574522.617064:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346839936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574522.617103:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1787574522.621093:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000100:00100000:0.0:1787574522.624329:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346839936 00000100:00100000:0.0:1787574522.624345:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346839936 00000100:00100000:0.0:1787574522.624406:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787574522.624417:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346839936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574522.624457:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787574522.625956:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346839936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1523us (8835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574522.625970:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000001:00080000:0.0:1787574522.629964:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1787574522.629979:0:6488:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787574522.630256:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787574522.630267:0:6541:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1787574522.637420:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346839936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574522.637445:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574522.637541:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574522.637574:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574522.637607:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574522.637627:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574522.637646:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574522.637668:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574522.637705:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323714432 00000100:00100000:0.0:1787574522.637712:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323714432 00000100:00100000:0.0:1787574522.637759:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323714304 00000100:00100000:0.0:1787574522.637762:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323714304 00000100:00100000:0.0:1787574522.637784:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:0.0:1787574522.637792:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323714432:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574522.637870:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323714432:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 77us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574522.637877:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:0.0:1787574522.637893:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:0.0:1787574522.637900:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323714304:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574522.637936:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2404:x1874407323714304:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 37us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574522.637943:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00080000:0.0:1787574522.637963:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574522.637967:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574522.637977:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323714176 00000100:00100000:0.0:1787574522.637981:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323714176 00000100:00100000:0.0:1787574522.638000:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323714688 00000100:00100000:0.0:1787574522.638003:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323714688 00000100:00100000:0.0:1787574522.638019:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323714048 00000100:00100000:0.0:1787574522.638022:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323714048 00000100:00100000:0.0:1787574522.638033:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323714560 00000100:00100000:0.0:1787574522.638035:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323714560 00000100:00100000:0.0:1787574522.638047:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 417 00000100:00100000:0.0:1787574522.638054:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323714176:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574522.638081:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2404:x1874407323714176:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574522.638097:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 417 00000100:00100000:0.0:1787574522.638109:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 418 00000100:00100000:0.0:1787574522.638115:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323714688:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574522.638140:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2404:x1874407323714688:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574522.638157:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 418 00000100:00100000:0.0:1787574522.638169:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 419 00000100:00100000:0.0:1787574522.638175:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:2404:x1874407323714048:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574522.638202:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:2404:x1874407323714048:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574522.638208:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 419 00000100:00100000:0.0:1787574522.638218:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 420 00000100:00100000:0.0:1787574522.638224:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+6:2404:x1874407323714560:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574522.638270:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+6:2404:x1874407323714560:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 45us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574522.638276:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 420 00000100:00080000:0.0:1787574522.638289:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787574522.640303:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323713920 00000100:00100000:2.0:1787574522.640317:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323713920 00000100:00100000:2.0:1787574522.640409:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 408 00000100:00100000:2.0:1787574522.640420:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323713920:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574522.640492:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2404:x1874407323713920:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 74us (3050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574522.640514:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 408 00010000:00010000:2.0:1787574523.569479:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574524.602567:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787574525.036594:0:14956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:28:42 (1787574522) 00010000:00010000:3.0:1787574525.617789:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574525.687912:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346840064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574525.687991:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574525.688870:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574525.688885:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346840192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574525.688927:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574525.688978:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346840064 00000100:00100000:2.0:1787574525.688985:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346840064 00000100:00100000:2.0:1787574525.689033:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346840192 00000100:00100000:2.0:1787574525.689037:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346840192 00000100:00100000:2.0:1787574525.689056:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787574525.689065:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346840064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574525.689094:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787574525.689141:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346840064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574525.689149:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787574525.689168:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787574525.691447:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346840192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574525.691474:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787574525.691543:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346840192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (2617us total) trans 0 rc 0/0 00000100:00080000:3.0:1787574525.692487:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574525.693351:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346840192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574525.693366:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1787574525.693371:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca53bf8ea00, transno 4294967325 00000100:00100000:3.0:1787574525.693454:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346840064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574525.697572:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00010000:00010000:3.0:1787574526.641752:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574527.218035:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574527.218060:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346840320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574527.218130:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574527.218228:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346840320 00000100:00100000:0.0:1787574527.218236:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346840320 00000100:00100000:0.0:1787574527.218320:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787574527.218329:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346840320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574527.218361:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787574527.218541:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346840320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 212us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.218563:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787574527.218948:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346840320:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787574527.665509:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574527.729685:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346840576:0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.729763:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574527.729835:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346841088:0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.729856:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574527.729875:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346841600:0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.729893:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574527.729913:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787574527.729919:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346840704:0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.729938:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574527.729951:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346841216:0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.729969:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574527.729985:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346841728:0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.730002:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574527.730046:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346841216 00000100:00100000:2.0:1787574527.730052:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346841216 00000100:00100000:2.0:1787574527.730103:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346841728 00000100:00100000:2.0:1787574527.730106:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346841728 00000100:00100000:2.0:1787574527.730124:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787574527.730133:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346841216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.730275:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346841216:12345-0@lo:400:kworker.0 Request processed in 143us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574527.730282:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787574527.730296:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787574527.730302:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346841728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.730327:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346841728:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574527.730332:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787574527.730364:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346841216:0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.730382:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346841728:0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.730871:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346840576 00000100:00100000:0.0:1787574527.730876:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346840576 00000100:00100000:0.0:1787574527.730920:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346841088 00000100:00100000:0.0:1787574527.730924:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346841088 00000100:00100000:0.0:1787574527.730937:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346841600 00000100:00100000:0.0:1787574527.730940:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346841600 00000100:00100000:0.0:1787574527.730951:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346840704 00000100:00100000:0.0:1787574527.730954:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346840704 00000100:00100000:0.0:1787574527.730966:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1787574527.730972:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346840576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731015:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346840576:12345-0@lo:400:kworker.0 Request processed in 43us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.731021:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1787574527.731035:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1787574527.731041:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346841088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731069:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346841088:12345-0@lo:400:kworker.0 Request processed in 28us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.731075:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1787574527.731101:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1787574527.731109:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346841600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731137:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346841600:12345-0@lo:400:kworker.0 Request processed in 30us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.731143:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1787574527.731168:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1787574527.731174:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346840704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731226:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346840704:12345-0@lo:400:kworker.0 Request processed in 52us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.731232:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1787574527.731286:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346840448:0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574527.731344:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346840960:0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731374:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574527.731391:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346841472:0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731410:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574527.731428:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787574527.731434:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346840832:0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731455:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574527.731470:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346841344:0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731488:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574527.731503:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346841856:0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731522:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574527.731543:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346840960 00000100:00100000:0.0:1787574527.731547:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346840960 00000100:00100000:0.0:1787574527.731568:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346841472 00000100:00100000:0.0:1787574527.731570:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346841472 00000100:00100000:0.0:1787574527.731584:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1787574527.731589:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346840960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731621:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346840960:12345-0@lo:400:kworker.0 Request processed in 31us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.731628:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1787574527.731904:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1787574527.731912:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346841472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.731944:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346841472:12345-0@lo:400:kworker.0 Request processed in 33us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.731950:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1787574527.731967:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346841344 00000100:00100000:0.0:1787574527.731970:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346841344 00000100:00100000:0.0:1787574527.731992:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346841856 00000100:00100000:0.0:1787574527.731995:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346841856 00000100:00100000:0.0:1787574527.732014:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787574527.732018:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346841344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.732048:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346841344:12345-0@lo:400:kworker.0 Request processed in 29us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.732053:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787574527.732062:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787574527.732067:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346841856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.732089:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346841856:12345-0@lo:400:kworker.0 Request processed in 22us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.732093:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787574527.732124:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346841344:0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.732134:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346841856:0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.732142:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346840960:0@lo:400:kworker.0 00000100:00100000:1.0:1787574527.732319:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346840832 00000100:00100000:1.0:1787574527.732324:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346840832 00000100:00100000:1.0:1787574527.732354:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787574527.732360:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346840832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574527.732408:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346840832:12345-0@lo:400:kworker.0 Request processed in 48us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574527.732414:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787574527.732768:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346841472:0@lo:400:kworker.0 00000100:00100000:0.0:1787574527.732795:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346840832:0@lo:400:kworker.0 00000100:00080000:3.0:1787574527.732928:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574527.732933:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574527.732936:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574527.732938:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574527.733059:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574527.733073:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346841984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574527.733127:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574527.733400:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346841984 00000100:00100000:1.0:1787574527.733405:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346841984 00000100:00100000:1.0:1787574527.733440:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787574527.733448:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346841984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787574527.733468:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787574527.733501:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346841984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574527.733507:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787574527.733576:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346841984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574527.734536:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346840448 00000100:00100000:2.0:1787574527.734541:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346840448 00000100:00100000:2.0:1787574527.734573:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1787574527.734579:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346840448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.734631:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3635:x1874407346840448:12345-0@lo:400:kworker.0 Request processed in 53us (3310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574527.734649:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1787574527.734693:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346842112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574527.734720:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574527.734751:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346840704:0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.734763:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346840576:0@lo:400:kworker.0 00010000:00080000:2.0:1787574527.734776:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4f5500 x1874407346841088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574527.734786:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346841088:0@lo:400:kworker.0 00010000:00080000:2.0:1787574527.734798:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4f6a00 x1874407346841600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574527.734818:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346841600:0@lo:400:kworker.0 00000100:00100000:2.0:1787574527.734847:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346842112 00000100:00100000:2.0:1787574527.734850:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346842112 00000100:00100000:2.0:1787574527.734874:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787574527.734880:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346842112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574527.734892:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787574527.734938:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346842112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574527.734945:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787574527.734974:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346842112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574527.735076:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3635:1874407346840448:0@lo:400:kworker.0 00000100:00100000:3.0:1787574527.739206:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346842240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574527.739303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574527.748420:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346842240 00000100:00100000:0.0:1787574527.748435:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346842240 00000100:00100000:0.0:1787574527.748514:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787574527.748525:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346842240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574527.748561:0:10749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787574527.748652:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346842240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (9348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.748659:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787574527.748985:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346842240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574527.753854:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574527.753899:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574527.753937:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574527.753966:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574527.753989:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574527.754010:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574527.754075:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574527.754106:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323715328 00000100:00100000:0.0:1787574527.754115:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323715328 00000100:00100000:0.0:1787574527.754164:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323715200 00000100:00100000:0.0:1787574527.754167:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323715200 00000100:00100000:0.0:1787574527.754187:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:0.0:1787574527.754196:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323715328:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574527.754298:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323715328:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 102us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.754305:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:0.0:1787574527.754319:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:0.0:1787574527.754325:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323715200:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574527.754368:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2405:x1874407323715200:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 42us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.754375:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:0.0:1787574527.754493:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323715072 00000100:00100000:0.0:1787574527.754497:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323715072 00000100:00100000:0.0:1787574527.754525:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323715584 00000100:00100000:0.0:1787574527.754527:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323715584 00000100:00100000:0.0:1787574527.754540:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323714944 00000100:00100000:0.0:1787574527.754543:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323714944 00000100:00100000:0.0:1787574527.754555:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323715456 00000100:00100000:0.0:1787574527.754558:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323715456 00000100:00100000:0.0:1787574527.754572:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 427 00000100:00100000:0.0:1787574527.754578:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323715072:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574527.754610:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2405:x1874407323715072:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 32us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.754617:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 427 00000100:00100000:0.0:1787574527.754629:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 428 00000100:00100000:0.0:1787574527.754636:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323715584:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574527.754658:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+5:2405:x1874407323715584:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.754664:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 428 00000100:00100000:0.0:1787574527.754675:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 429 00000100:00100000:0.0:1787574527.754680:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:2405:x1874407323714944:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574527.754701:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:2405:x1874407323714944:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.754715:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 429 00000100:00100000:0.0:1787574527.754726:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 430 00000100:00100000:0.0:1787574527.754732:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+6:2405:x1874407323715456:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574527.754759:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323714816 00000100:00100000:2.0:1787574527.754766:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323714816 00000100:00100000:0.0:1787574527.754768:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0874c266-15f3-4d8d-abed-9d908d92af46+6:2405:x1874407323715456:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 35us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574527.754776:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 430 00000100:00100000:2.0:1787574527.754852:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 410 00000100:00100000:2.0:1787574527.754863:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323714816:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574527.754893:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2405:x1874407323714816:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574527.754901:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 410 00000100:00080000:3.0:1787574527.755465:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574527.755470:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574527.755473:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574527.755475:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787574528.693879:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574529.552873:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574529.553040:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323715840 00000100:00100000:2.0:1787574529.553050:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323715840 00000100:00100000:2.0:1787574529.553129:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:2.0:1787574529.553141:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+18:13210:x1874407323715840:12345-192.168.202.40@tcp:35:umount.0 00000100:00080000:3.0:1787574529.554534:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574529.554879:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:13210:x1874407323715840:12345-192.168.202.40@tcp:35:umount.0 Request processed in 1737us (2009us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787574529.554889:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:0.0:1787574529.560391:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574529.560629:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323716096 00000100:00100000:1.0:1787574529.560640:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323716096 00000100:00100000:1.0:1787574529.560810:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:1.0:1787574529.560821:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+19:13210:x1874407323716096:12345-192.168.202.40@tcp:35:umount.0 00000100:00100000:1.0:1787574529.561300:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:13210:x1874407323716096:12345-192.168.202.40@tcp:35:umount.0 Request processed in 478us (989us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787574529.561784:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:0.0:1787574529.566180:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574529.566313:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323716352 00000100:00100000:2.0:1787574529.566382:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323716352 00000100:00100000:1.0:1787574529.566573:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:1.0:1787574529.566585:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518c35850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+20:13210:x1874407323716352:12345-192.168.202.40@tcp:35:umount.0 00000100:00100000:1.0:1787574529.567619:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518c35850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:13210:x1874407323716352:12345-192.168.202.40@tcp:35:umount.0 Request processed in 1032us (1444us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787574529.567630:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:0.0:1787574529.579423:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574529.582911:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323716608 00000100:00100000:2.0:1787574529.582926:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323716608 00000100:00100000:2.0:1787574529.582998:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1787574529.583009:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+21:13210:x1874407323716608:12345-192.168.202.40@tcp:35:umount.0 00000100:00100000:2.0:1787574529.583443:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:13210:x1874407323716608:12345-192.168.202.40@tcp:35:umount.0 Request processed in 424us (4019us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1787574529.584687:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:0.0:1787574529.593339:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574529.593375:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574529.593406:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574529.593431:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574529.593590:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323716864 00000100:00100000:1.0:1787574529.593600:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323716864 00000100:00100000:1.0:1787574529.593666:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:1.0:1787574529.593677:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2401:x1874407323716864:12345-192.168.202.40@tcp:9:umount.0 00000020:00000080:1.0:1787574529.593725:0:8619:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb827e 00000100:00080000:1.0:1787574529.593733:0:8619:0:(import.c:65:import_set_state_nolock()) ffff9ca53f4a1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787574529.593780:0:8619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787574529.593941:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+2:2401:x1874407323716864:12345-192.168.202.40@tcp:9:umount.0 Request processed in 265us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574529.593949:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:3.0:1787574529.594156:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323716736 00000100:00100000:3.0:1787574529.594162:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323716736 00000100:00100000:3.0:1787574529.594206:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323717120 00000100:00100000:3.0:1787574529.594209:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323717120 00000100:00100000:3.0:1787574529.594222:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323716992 00000100:00100000:3.0:1787574529.594224:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323716992 00000100:00100000:3.0:1787574529.594258:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1787574529.594266:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24bb2d4e-8223-4dd7-b95b-94a02d249511+15:2403:x1874407323716736:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574529.594277:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574529.594294:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be98000/0xd18a1efeeddb7f60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b571 expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.594308:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574529.594328:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24bb2d4e-8223-4dd7-b95b-94a02d249511+14:2403:x1874407323716736:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 64us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574529.594335:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1787574529.594347:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1787574529.594353:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24bb2d4e-8223-4dd7-b95b-94a02d249511+13:2403:x1874407323717120:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574529.594359:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574529.594368:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb817b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b64a expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.594376:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574529.594393:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:2403:x1874407323717120:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 40us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574529.594399:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1787574529.594412:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1787574529.594430:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:2403:x1874407323716992:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574529.594437:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574529.594445:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb7ea3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b532 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.594466:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574529.594484:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2403:x1874407323716992:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 55us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574529.594489:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00010000:00010000:3.0:1787574529.594509:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574529.594947:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574529.606702:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574529.607184:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323717504 00000100:00100000:3.0:1787574529.607194:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323717504 00000100:00100000:3.0:1787574529.607289:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:3.0:1787574529.607301:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+7:2401:x1874407323717504:12345-192.168.202.40@tcp:9:umount.0 00000020:00000080:3.0:1787574529.607331:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb84f4 00000020:00010000:3.0:1787574529.607340:0:8423:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ca404109000: total 0 00000100:00080000:3.0:1787574529.607345:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9ca40410a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574529.607391:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787574529.607622:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2401:x1874407323717504:12345-192.168.202.40@tcp:9:umount.0 Request processed in 323us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574529.607631:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00000020:00010000:2.0:1787574529.607728:0:13730:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ca404109000: total 0 00010000:00010000:2.0:1787574529.607766:0:13730:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ca404109000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787574529.607829:0:13730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb8f7b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba17 expref: 4 pid: 8619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574529.607862:0:13730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000037c87fc/0xd18a1efeeddb88ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b834 expref: 3 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574529.607877:0:13730:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ca404109000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787574529.607889:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574529.607891:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574529.607893:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574529.607991:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574529.625412:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574529.625533:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323718528 00000100:00100000:2.0:1787574529.625542:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323718528 00000100:00100000:2.0:1787574529.625607:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 258 00000100:00100000:2.0:1787574529.625619:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+22:2401:x1874407323718528:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:2.0:1787574529.625653:0:11515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7eb1 00000020:00010000:2.0:1787574529.625669:0:11515:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ca403555800: total 0 00000100:00080000:2.0:1787574529.625675:0:11515:0:(import.c:65:import_set_state_nolock()) ffff9ca403550800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787574529.625799:0:13731:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ca403555800: total 0 00010000:00010000:3.0:1787574529.625854:0:13731:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ca403555800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787574529.625938:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a50d00) 00010000:00010000:3.0:1787574529.625942:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574529.625949:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10000/0xd18a1efeeddb8915 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b850 expref: 21 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626006:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:3.0:1787574529.626009:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787574529.626014:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb400/0xd18a1efeeddb8f66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba10 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626041:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574529.626044:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787574529.626048:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb8254 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b674 expref: 19 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626061:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:3.0:1787574529.626063:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574529.626067:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb886d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b81f expref: 18 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626079:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574529.626081:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574529.626084:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fab000/0xd18a1efeeddb8c1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b930 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626099:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:3.0:1787574529.626101:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787574529.626104:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb8897 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b82d expref: 16 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626118:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ca52057fa00) 00010000:00010000:3.0:1787574529.626121:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574529.626134:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10a00/0xd18a1efeeddb854f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b74d expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626154:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca52057fd00) 00010000:00010000:3.0:1787574529.626157:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574529.626160:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83400/0xd18a1efeeddb81f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b65f expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626176:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:3.0:1787574529.626178:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574529.626182:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb8e5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b9ca expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626194:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ca5186cae00) 00010000:00010000:3.0:1787574529.626196:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787574529.626200:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb8931 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b857 expref: 12 pid: 8610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626213:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ca520573600) 00010000:00010000:3.0:1787574529.626216:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574529.626219:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c11200/0xd18a1efeeddb878d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b7e7 expref: 11 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626232:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ca534a50700) 00010000:00010000:3.0:1787574529.626235:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574529.626290:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5421fb600/0xd18a1efeeddb8f3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba02 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574529.626307:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ca534a4c700) 00010000:00010000:3.0:1787574529.626314:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000001:00000004:2.0:1787574529.626409:0:11515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1787574529.626554:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+9:2401:x1874407323718528:12345-192.168.202.40@tcp:39:umount.0 Request processed in 937us (1153us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1787574529.626562:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 258 00010000:00010000:3.0:1787574529.627830:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca535c10600/0xd18a1efeeddb81dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b658 expref: 8 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574529.632484:0:13731:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ca403555800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787574529.632538:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574529.632556:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574529.632560:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574529.641431:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574529.641584:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323718656 00000100:00100000:3.0:1787574529.641594:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323718656 00000100:00100000:3.0:1787574529.641671:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 259 00000100:00100000:3.0:1787574529.641683:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+5:2401:x1874407323718656:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:3.0:1787574529.641725:0:6509:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7eb8 00000100:00080000:3.0:1787574529.641740:0:6509:0:(import.c:65:import_set_state_nolock()) ffff9ca4033b8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574529.641771:0:6509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787574529.642060:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574529.642184:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574529.642222:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aeb3668-c6f6-4338-ab9b-0a7c9161b421+3:2401:x1874407323718656:12345-192.168.202.40@tcp:39:umount.0 Request processed in 539us (800us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787574529.642231:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 259 00010000:00010000:3.0:1787574529.714905:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574530.737611:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574530.802209:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574530.802235:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346842368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574530.802335:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574530.802463:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346842368 00000100:00100000:1.0:1787574530.802472:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346842368 00000100:00100000:1.0:1787574530.802585:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787574530.802597:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346842368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574530.802640:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787574530.802687:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346842368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574530.802694:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1787574530.802892:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574530.802932:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5045a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346842368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574530.803096:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346842496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574530.803139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574530.803216:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346842496 00000100:00100000:2.0:1787574530.803222:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346842496 00000100:00100000:2.0:1787574530.803296:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787574530.803314:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346842496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574530.803327:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787574530.803364:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346842496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574530.803371:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1787574530.803648:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574530.803674:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346842496:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1787574531.185952:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787574531.269465:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574531.269510:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574531.269557:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574531.270863:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323718784 00000100:00100000:2.0:1787574531.270876:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323718784 00000100:00100000:2.0:1787574531.270944:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323719040 00000100:00100000:2.0:1787574531.270948:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323719040 00000100:00100000:2.0:1787574531.270961:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323718912 00000100:00100000:2.0:1787574531.270964:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323718912 00000100:00100000:2.0:1787574531.270983:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1787574531.270991:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+12:2402:x1874407323718784:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574531.271008:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574531.271026:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb7fb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b586 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574531.271043:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574531.271097:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+11:2402:x1874407323718784:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 106us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574531.271104:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1787574531.271120:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1787574531.271141:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+10:2402:x1874407323719040:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574531.271161:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574531.271171:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82400/0xd18a1efeeddb8174 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b643 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574531.271181:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574531.271198:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+9:2402:x1874407323719040:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 58us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574531.271205:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1787574531.271285:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:2.0:1787574531.271293:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+8:2402:x1874407323718912:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574531.271300:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574531.271309:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb7fbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b5b7 expref: 8 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574531.271318:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574531.271334:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24bb2d4e-8223-4dd7-b95b-94a02d249511+7:2402:x1874407323718912:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 42us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574531.271340:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:2.0:1787574531.279356:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574531.279446:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323719296 00000100:00100000:1.0:1787574531.279467:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323719296 00000100:00100000:1.0:1787574531.279537:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 260 00000100:00100000:1.0:1787574531.279548:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+6:2401:x1874407323719296:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:1.0:1787574531.279586:0:8610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7fc9 00000020:00010000:1.0:1787574531.279594:0:8610:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ca4033da800: total 0 00000100:00080000:1.0:1787574531.279598:0:8610:0:(import.c:65:import_set_state_nolock()) ffff9ca4033df800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787574531.279620:0:8610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:1.0:1787574531.279818:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0874c266-15f3-4d8d-abed-9d908d92af46+5:2401:x1874407323719296:12345-192.168.202.40@tcp:39:umount.0 Request processed in 271us (471us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1787574531.279826:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 260 00000020:00010000:2.0:1787574531.280194:0:13731:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ca4033da800: total 0 00010000:00010000:2.0:1787574531.280279:0:13731:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ca4033da800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787574531.280318:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a50d00) 00010000:00010000:2.0:1787574531.280321:0:13731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574531.280329:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18600/0xd18a1efeeddb8f89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba1e expref: 4 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574531.280364:0:13731:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ca4033da800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787574531.280377:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574531.280379:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574531.280381:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574531.280547:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1787574531.286174:0:6488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0874c266-15f3-4d8d-abed-9d908d92af46 00000001:00080000:1.0:1787574531.286189:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1787574531.286195:0:6488:0:(genops.c:885:class_export_put()) final put ffff9ca4033da800/0874c266-15f3-4d8d-abed-9d908d92af46 00000001:00100000:1.0:1787574531.286286:0:6488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000001:00080000:1.0:1787574531.286291:0:6488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1787574531.286299:0:6488:0:(genops.c:885:class_export_put()) final put ffff9ca403555800/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000020:00000080:2.0:1787574531.286375:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033da800/0874c266-15f3-4d8d-abed-9d908d92af46 for lustre-MDT0000 00000020:00000080:2.0:1787574531.286444:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4033df800 for lustre-MDT0000 00000100:00100000:0.0:1787574531.286886:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574531.286960:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323719424 00000100:00100000:2.0:1787574531.286968:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323719424 00000100:00100000:2.0:1787574531.287035:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 261 00000100:00100000:2.0:1787574531.287045:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+5:2401:x1874407323719424:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:2.0:1787574531.287130:0:6511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7fd0 00000100:00080000:2.0:1787574531.287140:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787574531.287173:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787574531.287346:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0874c266-15f3-4d8d-abed-9d908d92af46+3:2401:x1874407323719424:12345-192.168.202.40@tcp:39:umount.0 Request processed in 302us (466us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787574531.287353:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 261 00010000:00010000:2.0:1787574531.287395:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574531.287568:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1787574531.293431:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403555800/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 for lustre-MDT0000 00000020:00000080:3.0:1787574531.298898:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca403550800 for lustre-MDT0000 00000100:00100000:1.0:1787574531.329705:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574531.329802:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323719680 00000100:00100000:2.0:1787574531.329812:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323719680 00000100:00100000:2.0:1787574531.329867:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 411 00000100:00100000:2.0:1787574531.329878:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+7:2401:x1874407323719680:12345-192.168.202.40@tcp:251:umount.0 00000020:00000080:2.0:1787574531.329922:0:6504:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7e8e 00000020:00010000:2.0:1787574531.329929:0:6504:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ca4033bb000: total 0 00000100:00080000:2.0:1787574531.329935:0:6504:0:(import.c:65:import_set_state_nolock()) ffff9ca4033bf000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787574531.330007:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24bb2d4e-8223-4dd7-b95b-94a02d249511+3:2401:x1874407323719680:12345-192.168.202.40@tcp:251:umount.0 Request processed in 130us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574531.330033:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 411 00000020:00010000:3.0:1787574531.330183:0:6497:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ca4033bb000: total 0 00010000:00010000:3.0:1787574531.330188:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574531.330280:0:6497:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ca4033bb000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787574531.330315:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be98200/0xd18a1efeeddb7f67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9b578 expref: 2 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574531.330329:0:6497:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ca4033bb000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787574531.330339:0:6497:0:(genops.c:885:class_export_put()) final put ffff9ca4033bb000/24bb2d4e-8223-4dd7-b95b-94a02d249511 00010000:00010000:3.0:1787574531.330351:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574531.330360:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574531.330361:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787574531.330802:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033bb000/24bb2d4e-8223-4dd7-b95b-94a02d249511 for MGS 00000020:00000080:2.0:1787574531.330833:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4033bf000 for MGS 00000040:00080000:0.0:1787574531.507074:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787574531.507084:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574531.507167:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787574531.507175:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787574531.761470:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574532.344359:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574532.344383:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346842624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574532.344497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574532.346340:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346842624 00000100:00100000:2.0:1787574532.346353:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346842624 00000100:00100000:2.0:1787574532.346407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787574532.346417:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346842624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574532.346453:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787574532.346522:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346842624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574532.346534:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787574532.346588:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346842624:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787574532.807526:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574532.851363:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346842752:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.851439:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574532.851484:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346843264:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.851562:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574532.851585:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346843776:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.851609:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574532.851628:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346844288:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.851648:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574532.851673:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787574532.851679:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346843136:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.851704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574532.851737:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346843648:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.851771:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574532.851789:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346844160:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.851809:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574532.851841:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346842752 00000100:00100000:2.0:1787574532.851848:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346842752 00000100:00100000:2.0:1787574532.851892:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1787574532.851901:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346842752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.852020:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346842752:12345-0@lo:400:kworker.0 Request processed in 120us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574532.852028:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1787574532.852062:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346843264 00000100:00100000:2.0:1787574532.852066:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346843264 00000100:00100000:2.0:1787574532.852090:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787574532.852097:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346843264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.852131:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346843264:12345-0@lo:400:kworker.0 Request processed in 35us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574532.852137:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787574532.852155:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346843776 00000100:00100000:2.0:1787574532.852159:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346843776 00000100:00100000:2.0:1787574532.852185:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346844288 00000100:00100000:2.0:1787574532.852189:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346844288 00000100:00100000:2.0:1787574532.852202:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346843648 00000100:00100000:2.0:1787574532.852204:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346843648 00000100:00100000:2.0:1787574532.852217:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346844160 00000100:00100000:2.0:1787574532.852220:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346844160 00000100:00100000:2.0:1787574532.852235:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787574532.853065:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346843776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.853121:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346843776:12345-0@lo:400:kworker.0 Request processed in 66us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574532.853127:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787574532.853144:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787574532.853150:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346844288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.853172:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346844288:12345-0@lo:400:kworker.0 Request processed in 23us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574532.853177:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787574532.853185:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787574532.853190:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346843648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.853211:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346843648:12345-0@lo:400:kworker.0 Request processed in 21us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574532.853216:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787574532.853226:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787574532.853231:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346844160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.853271:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346844160:12345-0@lo:400:kworker.0 Request processed in 39us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574532.853276:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787574532.853296:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346843136 00000100:00100000:2.0:1787574532.853301:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346843136 00000100:00100000:2.0:1787574532.853335:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1787574532.853341:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346843136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.853371:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346843136:12345-0@lo:400:kworker.0 Request processed in 30us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574532.853376:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1787574532.853427:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346843136:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.853442:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346843648:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.853453:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346844160:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.853461:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346842752:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.853470:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346843264:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.853480:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346843776:0@lo:400:kworker.0 00000100:00100000:2.0:1787574532.853490:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346844288:0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.853879:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346843008:0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.853961:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574532.853987:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346843520:0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.854012:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574532.854029:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346844032:0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.854049:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574532.854068:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787574532.854074:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346842880:0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.854094:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574532.854110:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346843392:0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.854138:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574532.854154:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346843904:0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.854172:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574532.854196:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346843008 00000100:00100000:0.0:1787574532.854201:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346843008 00000100:00100000:0.0:1787574532.854230:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787574532.854237:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346843008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.854394:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346843008:12345-0@lo:400:kworker.0 Request processed in 157us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574532.854472:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787574532.854640:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346843520 00000100:00100000:0.0:1787574532.854645:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346843520 00000100:00100000:0.0:1787574532.854667:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1787574532.854674:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346843520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.854794:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346843520:12345-0@lo:400:kworker.0 Request processed in 121us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574532.854801:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1787574532.854812:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346844032 00000100:00100000:0.0:1787574532.854815:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346844032 00000100:00100000:0.0:1787574532.854830:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346842880 00000100:00100000:0.0:1787574532.854832:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346842880 00000100:00100000:0.0:1787574532.854842:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346843392 00000100:00100000:0.0:1787574532.854844:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346843392 00000100:00100000:0.0:1787574532.854855:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346843904 00000100:00100000:0.0:1787574532.854857:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346843904 00000100:00100000:0.0:1787574532.854871:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1787574532.854877:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346844032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.854904:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346844032:12345-0@lo:400:kworker.0 Request processed in 28us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574532.854919:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1787574532.854931:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1787574532.854937:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346842880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.854964:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346842880:12345-0@lo:400:kworker.0 Request processed in 27us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574532.854969:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1787574532.854979:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1787574532.854985:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346843392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.855009:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346843392:12345-0@lo:400:kworker.0 Request processed in 25us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574532.855014:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1787574532.855024:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1787574532.855031:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346843904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.855056:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346843904:12345-0@lo:400:kworker.0 Request processed in 26us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574532.855061:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1787574532.855106:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346842880:0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.855116:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346843392:0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.855126:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346843904:0@lo:400:kworker.0 00000100:00100000:0.0:1787574532.855135:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346843008:0@lo:400:kworker.0 00010000:00080000:0.0:1787574532.855146:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4f4700 x1874407346843520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574532.855156:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346843520:0@lo:400:kworker.0 00010000:00080000:0.0:1787574532.855174:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4f5f80 x1874407346844032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574532.855182:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346844032:0@lo:400:kworker.0 00000100:00080000:3.0:1787574532.865466:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574532.865477:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574532.865480:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574532.865483:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574532.865554:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346844416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574532.865624:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574532.865730:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346844416 00000100:00100000:3.0:1787574532.865737:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346844416 00000100:00100000:3.0:1787574532.866091:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787574532.866102:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346844416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574532.866134:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787574532.866179:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346844416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574532.866186:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787574532.866233:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346844416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574532.866301:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346844544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574532.866347:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574532.866379:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346844544 00000100:00100000:3.0:1787574532.866383:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346844544 00000100:00100000:3.0:1787574532.866408:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787574532.866415:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346844544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574532.866435:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574532.866469:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346844544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574532.866475:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787574532.866517:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346844544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574532.866636:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574532.866646:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346844672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574532.866677:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574532.869428:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346844672 00000100:00100000:0.0:1787574532.869442:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346844672 00000100:00100000:0.0:1787574532.869877:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787574532.869889:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346844672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574532.869914:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574532.869995:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346844672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (3317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574532.870002:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787574532.870059:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346844672:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1787574533.653167:0:15153:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787574533.666326:0:15153:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787574533.666389:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574533.666412:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574533.666420:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574533.666428:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574533.666457:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787574533.666463:0:15153:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787574533.666499:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787574533.666504:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787574533.666510:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787574533.666537:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9ca5350cb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787574533.666733:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574533.666741:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574533.666763:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574533.666767:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574533.666776:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574533.666784:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574533.666791:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787574533.666793:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787574533.666796:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787574533.666821:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574533.666828:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574533.666862:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574533.666864:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346844800:0@lo:39:umount.0 00010000:00010000:3.0:1787574533.666876:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb7f36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f3d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574533.666891:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574533.666893:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574533.666895:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574533.666938:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574533.667065:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346844800 00000100:00100000:3.0:1787574533.667072:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346844800 00000100:00100000:3.0:1787574533.667118:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787574533.667127:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874407346844800:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787574533.667150:0:11515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7aa5 00000100:00080000:3.0:1787574533.667159:0:11515:0:(import.c:65:import_set_state_nolock()) ffff9ca5350c9000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787574533.667224:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3633:x1874407346844800:12345-0@lo:39:umount.0 Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574533.667232:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1787574533.667278:0:11515:0:(genops.c:885:class_export_put()) final put ffff9ca5350ce000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787574533.667302:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787574533.667312:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350ce000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787574533.667362:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca5350c9000 for lustre-MDT0000 00000100:00100000:2.0:1787574533.667544:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346844928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574533.667581:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574533.667626:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346844928 00000100:00100000:2.0:1787574533.667631:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346844928 00000100:00100000:2.0:1787574533.667666:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787574533.667673:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3637:x1874407346844928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574533.667684:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574533.667701:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c10e00/0xd18a1efeeddb7f3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7f36 expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574533.667713:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574533.667741:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+23:3637:x1874407346844928:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574533.667748:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787574533.667791:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346844928:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787574533.669297:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5350cb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787574533.669318:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346844800:0@lo:39:umount.0 00000100:00080000:0.0:1787574533.669494:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787574533.669499:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787574533.669504:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787574533.672810:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672830:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672838:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672845:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672879:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574533.672887:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672893:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672900:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672906:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672932:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787574533.672939:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672946:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672953:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672960:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672971:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787574533.672975:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e18a00/0xd18a1efeeddb7a04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574533.672983:0:13730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787574533.672988:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e18a00/0xd18a1efeeddb7a04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574533.672990:0:13730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.672995:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e18a00/0xd18a1efeeddb7a04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574533.672998:0:13730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99600 already unused, calling callback (ffffffffc12c7c20) 00010000:00010000:0.0:1787574533.673000:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca509e18a00/0xd18a1efeeddb7a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574533.673002:0:13730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574533.673009:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1787574533.673012:0:15153:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1787574533.673015:0:13730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574533.673022:0:13730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574533.673027:0:13730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787574533.673030:0:13730:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1787574533.673032:0:13730:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000004:0.0:1787574533.673041:0:15153:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787574533.673046:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787574533.673049:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574533.673054:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1787574533.673061:0:15153:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ca40270f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1787574533.673064:0:13730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787574533.673067:0:15153:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ca53be11800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1787574533.673070:0:13730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1787574533.673073:0:15153:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ca5350a3000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787574533.673076:0:15153:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ca506ef2800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1787574533.673081:0:15153:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9ca520518000) has exports, disconnecting them 00000020:00080000:0.0:1787574533.673086:0:15153:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ca40270f000), last request at 1787574532 00010000:00010000:2.0:1787574533.673087:0:13730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787574533.673092:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7db5 00010000:00010000:2.0:1787574533.673093:0:13730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be99600/0xd18a1efeeddb7f44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574533.673105:0:13730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787574533.673108:0:13730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787574533.673108:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9ca40270e000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787574533.673114:0:13730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574533.673116:0:13730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574533.673121:0:13730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574533.673136:0:13730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574533.673142:0:13730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787574533.673143:0:13730:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787574533.673145:0:13730:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:0.0:1787574533.673147:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca40270f000): rc 0 00000020:00000080:0.0:1787574533.673149:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca40270f000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1787574533.673157:0:13730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787574533.673158:0:15153:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ca53be11800), last request at 1787574532 00010000:00010000:2.0:1787574533.673163:0:13730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1787574533.673165:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7c96 00010000:00010000:2.0:1787574533.673168:0:13730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787574533.673171:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9ca53be12000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787574533.673174:0:13730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb7e48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7e4f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787574533.673178:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca53be11800): rc 0 00000020:00000080:0.0:1787574533.673180:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca53be11800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1787574533.673184:0:13730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1787574533.673184:0:15153:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ca5350a3000), last request at 1787574255 00010000:00010000:2.0:1787574533.673187:0:13730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787574533.673187:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7b8c 00000100:00080000:0.0:1787574533.673190:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9ca535271000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787574533.673193:0:13730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83600 already unused, calling callback (ffffffffc12c7c20) 00000020:00080000:0.0:1787574533.673194:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca5350a3000): rc 0 10000000:00010000:2.0:1787574533.673196:0:13730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787574533.673196:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca5350a3000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787574533.673200:0:15153:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ca506ef2800), last request at 1787574255 00010000:00010000:2.0:1787574533.673202:0:13730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787574533.673202:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7b5b 00000100:00080000:0.0:1787574533.673205:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9ca506ef1800 : changing import state from FULL to CLOSED 10000000:00010000:2.0:1787574533.673209:0:13730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787574533.673210:0:15153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 10000000:01000000:2.0:1787574533.673222:0:13730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787574533.673224:0:13730:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787574533.673226:0:13730:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787574533.673516:0:13731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574533.673524:0:13731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca509e18a00/0xd18a1efeeddb7a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574533.673531:0:13731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574533.673534:0:13731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e18a00/0xd18a1efeeddb7a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574533.673541:0:13731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca509e18a00/0xd18a1efeeddb7a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574533.673549:0:13731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e18a00/0xd18a1efeeddb7a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574533.673555:0:13731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787574533.673557:0:13731:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787574533.673560:0:13731:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787574533.673582:0:13731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca509e18a00/0xd18a1efeeddb7a04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574533.673588:0:13731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574533.673603:0:13731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca509e18a00/0xd18a1efeeddb7a04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574533.673610:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca509e18a00/0xd18a1efeeddb7a04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7a0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574533.673620:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574533.673622:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574533.673624:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574533.673629:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574533.673634:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574533.673647:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346845056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574533.673711:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574533.673747:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346845056 00000100:00100000:1.0:1787574533.673766:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346845056 00000100:00100000:3.0:1787574533.673769:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574533.673777:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346845184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574533.673802:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574533.673815:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346845184 00000100:00100000:1.0:1787574533.673819:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346845184 00000100:00100000:3.0:1787574533.673837:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346845440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574533.673850:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574533.673862:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346845056:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574533.673868:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574533.673879:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787574533.673893:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346845440 00010000:00010000:1.0:1787574533.673896:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb7f4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7f44 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574533.673898:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346845440 00010000:00010000:1.0:1787574533.673920:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574533.673924:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787574533.673932:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346845184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574533.673941:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574533.673952:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c10c00/0xd18a1efeeddb7e4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7e48 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574533.673965:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+24:3634:x1874407346845056:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (254us total) trans 0 rc 0/0 00010000:00010000:3.0:1787574533.673979:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574533.673979:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787574533.674000:0:13730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574533.674007:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787574533.674009:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3634:x1874407346845184:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (207us total) trans 0 rc 0/0 00010000:00010000:2.0:1787574533.674012:0:13730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787574533.674017:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787574533.674022:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+22:3636:x1874407346845440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574533.674025:0:13730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574533.674031:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574533.674034:0:13730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb81ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb81b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574533.674035:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574533.674045:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346845312:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574533.674045:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574533.674046:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500030000/0xd18a1efeeddb7a0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7a04 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574533.674047:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574533.674050:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574533.674061:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574533.674068:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574533.674091:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:3636:x1874407346845440:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574533.674099:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787574533.674112:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346845440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574533.674113:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346845312 00000100:00100000:1.0:1787574533.674120:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346845312 00000020:00000080:3.0:1787574533.674142:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca40270f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1787574533.674144:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000020:00000080:3.0:1787574533.674191:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53be11800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1787574533.674270:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+20:3636:x1874407346845312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574533.674282:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574533.674292:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be99800/0xd18a1efeeddb81b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb81ac expref: 20 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574533.674301:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574533.674331:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:3636:x1874407346845312:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574533.674338:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787574533.674349:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346845312:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1787574533.674391:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350a3000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:0.0:1787574533.674594:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca506ef2800): rc 0 00000004:00000080:0.0:1787574533.674601:0:15153:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa7bcc1077ae0 00000100:00080000:0.0:1787574533.674618:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787574533.674621:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1787574533.674686:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346845184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574533.674701:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346845056:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787574533.675690:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787574533.675714:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9ca50501e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787574533.675888:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787574533.675891:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1787574533.675902:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787574533.675956:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787574533.675966:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9ca536beb000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787574533.675972:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787574533.675974:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1787574533.675983:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787574533.676042:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787574533.676061:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9ca403185000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787574533.676087:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ca520518000) has no exports 00000100:00100000:1.0:1787574533.677105:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346845568:0@lo:39:umount.0 00000100:00100000:1.0:1787574533.677175:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574533.677216:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346845696:0@lo:9:umount.0 00000100:00100000:1.0:1787574533.677260:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574533.677281:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346845824:0@lo:9:umount.0 00000100:00100000:1.0:1787574533.677301:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574533.677337:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346845696 00000100:00100000:1.0:1787574533.677344:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346845696 00000100:00100000:1.0:1787574533.677382:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346845824 00000100:00100000:1.0:1787574533.677385:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346845824 00000100:00100000:1.0:1787574533.677482:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787574533.677491:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1874407346845696:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787574533.677518:0:8619:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7d45 00000100:00080000:1.0:1787574533.677526:0:8619:0:(import.c:65:import_set_state_nolock()) ffff9ca536beb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787574533.677564:0:8619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787574533.677666:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787574533.677675:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874407346845824:12345-0@lo:9:umount.0 00000100:00100000:1.0:1787574533.677680:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3633:x1874407346845696:12345-0@lo:9:umount.0 Request processed in 191us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574533.677686:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000020:00000080:2.0:1787574533.677688:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7e79 00000100:00080000:2.0:1787574533.677692:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9ca403184800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787574533.677718:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:1.0:1787574533.677725:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca536beb000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787574533.677734:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787574533.677736:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787574533.677739:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346845696:0@lo:9:umount.0 00000100:00100000:2.0:1787574533.677819:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3633:x1874407346845824:12345-0@lo:9:umount.0 Request processed in 145us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574533.677826:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000020:00000080:3.0:1787574533.677832:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca40270e000 for lustre-MDT0000 00010000:00010000:3.0:1787574533.677844:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574533.677849:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574533.677933:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346845568 00000100:00100000:0.0:1787574533.677937:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346845568 00000100:00100000:0.0:1787574533.677973:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787574533.677980:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874407346845568:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787574533.677997:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7be7 00000100:00080000:0.0:1787574533.678003:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9ca52f1cf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787574533.678025:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1787574533.678118:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3633:x1874407346845568:12345-0@lo:39:umount.0 Request processed in 138us (942us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787574533.678124:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1787574533.678195:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca50501e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787574533.678201:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346845568:0@lo:39:umount.0 00000100:00080000:1.0:1787574533.678224:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca403185000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787574533.678263:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787574533.678265:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787574533.678268:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346845824:0@lo:9:umount.0 00010000:00010000:3.0:1787574533.678398:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787574533.678406:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca53be12000 for lustre-MDT0000 00000020:00000080:3.0:1787574533.678413:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca535271000 for lustre-MDT0000 00000020:00080000:1.0:1787574533.686780:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ca520518000) has no exports 00000020:00000080:1.0:1787574533.720505:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7a5f 00000020:00000080:1.0:1787574533.720519:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca52675c800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787574533.720661:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787574533.720678:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574533.720689:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787574533.720693:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9ca535083370) has no exports 00000020:00000080:1.0:1787574533.721167:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7a58 00000020:00000080:1.0:1787574533.721176:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca53509f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787574533.721205:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca52675c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787574533.721594:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53509f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787574533.721661:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574533.721670:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787574533.721673:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca5045c7800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787574533.721676:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5045c7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787574533.721684:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1787574533.809453:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574534.833640:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574535.863125:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574535.924429:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574535.924453:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346845952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574535.924527:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574535.924620:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346845952 00000100:00100000:2.0:1787574535.924628:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346845952 00000100:00100000:2.0:1787574535.924707:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787574535.924717:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346845952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574535.924753:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787574535.924804:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346845952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574535.924811:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787574535.924854:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346845952:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787574535.924875:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1787574535.925137:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787574535.925152:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1787574535.925158:0:7440:0:(genops.c:885:class_export_put()) final put ffff9ca52f1c9800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787574535.925183:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0874c266-15f3-4d8d-abed-9d908d92af46 00000001:00080000:1.0:1787574535.925188:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1787574535.925191:0:7440:0:(genops.c:885:class_export_put()) final put ffff9ca4033dc800/0874c266-15f3-4d8d-abed-9d908d92af46 00000001:00100000:1.0:1787574535.925197:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000001:00080000:1.0:1787574535.925203:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1787574535.925205:0:7440:0:(genops.c:885:class_export_put()) final put ffff9ca4033ba000/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000020:00000080:3.0:1787574535.925275:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca52f1c9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787574535.925341:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033dc800/0874c266-15f3-4d8d-abed-9d908d92af46 for lustre-MDT0001 00000020:00000080:3.0:1787574535.925385:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033ba000/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 for lustre-MDT0001 00000020:00000080:3.0:1787574535.925406:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca52f1cf000 for lustre-MDT0001 00000020:00000080:3.0:1787574535.925411:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4033de800 for lustre-MDT0001 00000020:00000080:3.0:1787574535.925414:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4033b8000 for lustre-MDT0001 00000001:00100000:0.0:1787574535.925784:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787574535.925789:0:9505:0:(genops.c:885:class_export_put()) final put ffff9ca403185800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787574535.925803:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787574535.925808:0:8419:0:(genops.c:885:class_export_put()) final put ffff9ca536bea000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787574535.925812:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000020:00000080:0.0:1787574535.925816:0:9505:0:(genops.c:885:class_export_put()) final put ffff9ca53f4a2000/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000001:00100000:2.0:1787574535.925818:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000020:00000080:2.0:1787574535.925823:0:8419:0:(genops.c:885:class_export_put()) final put ffff9ca404109000/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 00000020:00000080:3.0:1787574535.925883:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403185800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787574535.929834:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca536bea000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787574535.929958:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53f4a2000/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 for lustre-OST0001 00000020:00000080:3.0:1787574535.929978:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca404109000/1aeb3668-c6f6-4338-ab9b-0a7c9161b421 for lustre-OST0000 00000020:00000080:3.0:1787574535.929997:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca403184800 for lustre-OST0001 00000020:00000080:3.0:1787574535.930002:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca536beb800 for lustre-OST0000 00000020:00000080:3.0:1787574535.930006:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca53f4a1000 for lustre-OST0001 00000020:00000080:3.0:1787574535.930010:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca40410a000 for lustre-OST0000 00010000:00010000:3.0:1787574536.881454:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787574536.948153:0:6488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787574536.948162:0:6488:0:(genops.c:885:class_export_put()) final put ffff9ca506ef2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787574536.948262:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca506ef2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1787574536.953345:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca506ef1800 for lustre-MDT0000 00000100:00100000:3.0:1787574537.457445:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346846080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574537.457509:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574537.457618:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346846080 00000100:00100000:0.0:1787574537.457626:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346846080 00000100:00100000:0.0:1787574537.457678:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787574537.457686:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3635:x1874407346846080:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787574537.457702:0:10749:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787574537.460220:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3635:x1874407346846080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2525us (2701us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787574537.460233:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:02020000:3.0:1787574537.460531:0:3635:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1787574537.469680:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787574537.469687:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9ca535277800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787574537.469692:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787574537.484442:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9ca535277800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574537.484454:0:3635:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 194 00000100:00080000:3.0:1787574537.484462:0:3635:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ca535277800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574537.484499:0:3635:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53bf8c700 x1874407346846208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787574537.485396:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346846208:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787574537.485458:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574537.486058:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346846208 00000100:00100000:3.0:1787574537.486074:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346846208 00000100:00100000:3.0:1787574537.486114:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787574537.486121:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346846208:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1787574537.486138:0:6515:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787574537.493643:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346846208:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 7513us (8177us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787574537.493657:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1787574537.493836:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca535277800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787574537.493842:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787574537.493847:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346846208:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1787574537.905765:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787574537.972034:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787574537.972041:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787574537.972045:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca535277800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574537.972053:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 476 00000100:00080000:2.0:1787574537.972058:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787574537.972064:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ca535277800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574537.972097:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca40429b800 x1874407346846464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574537.972154:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346846720:0@lo:400:kworker.0 00000100:00100000:2.0:1787574537.972216:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574537.972326:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346846720 00000100:00100000:2.0:1787574537.972332:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346846720 00000100:00100000:2.0:1787574537.972368:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787574537.972376:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1874407346846720:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787574537.972384:0:6509:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787574537.972417:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1874407346846720:12345-0@lo:400:kworker.0 Request processed in 41us (201us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787574537.972423:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:2.0:1787574537.972455:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787574537.972459:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787574537.972462:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787574537.972972:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346846592:0@lo:400:kworker.0 00000100:00100000:0.0:1787574537.973005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574537.973038:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574537.973043:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346846336:0@lo:400:kworker.0 00000100:00100000:0.0:1787574537.973068:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574537.973106:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346846592 00000100:00100000:0.0:1787574537.973110:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346846592 00000100:00100000:0.0:1787574537.973130:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787574537.973135:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1874407346846592:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787574537.973141:0:8610:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787574537.973171:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1874407346846592:12345-0@lo:400:kworker.0 Request processed in 35us (165us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787574537.973176:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787574537.973193:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346846336 00000100:00100000:0.0:1787574537.973195:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346846336 00000100:00100000:0.0:1787574537.973221:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1787574537.973227:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:3637:x1874407346846336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574537.973270:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51e8c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1+19:3637:x1874407346846336:12345-0@lo:400:kworker.0 Request processed in 43us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574537.973276:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1787574537.973371:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3637:1874407346846336:0@lo:400:kworker.0 00000100:00080000:0.0:1787574537.973380:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787574537.973384:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9ca5267f0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787574537.973387:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787574537.973391:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9ca5267f0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574537.973394:0:3637:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 194 00000100:00080000:0.0:1787574537.973399:0:3637:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ca5267f0800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574537.973417:0:3637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404239c00 x1874407346846848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574537.973436:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346846592:0@lo:400:kworker.0 00000100:00100000:0.0:1787574537.973490:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574537.973495:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346847104:0@lo:400:kworker.0 00000100:00100000:0.0:1787574537.973521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574537.973553:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346847232:0@lo:400:kworker.0 00000100:00100000:0.0:1787574537.973571:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574537.973592:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346847232 00000100:00100000:0.0:1787574537.973595:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346847232 00000100:00100000:0.0:1787574537.973612:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787574537.973617:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874407346847232:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787574537.973622:0:6511:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787574537.973644:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874407346847232:12345-0@lo:400:kworker.0 Request processed in 27us (73us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787574537.973649:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1787574537.973666:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787574537.973669:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9ca53b11f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787574537.973673:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787574537.973676:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9ca53b11f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574537.973679:0:3637:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 244 00000100:00080000:0.0:1787574537.973683:0:3637:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ca53b11f800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574537.973694:0:3637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca40423bb80 x1874407346847360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574537.973705:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346847232:0@lo:400:kworker.0 00000100:00100000:0.0:1787574537.973794:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574537.973805:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346847744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574537.973831:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574537.973852:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346847744 00000100:00100000:0.0:1787574537.973855:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346847744 00000100:00100000:0.0:1787574537.973883:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787574537.973889:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346847744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574537.973908:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787574537.973937:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346847744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574537.973944:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:0.0:1787574537.973958:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574537.973978:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346847744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574537.974355:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346846976:0@lo:400:kworker.0 00000100:00100000:3.0:1787574537.974384:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574537.974406:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346846976 00000100:00100000:3.0:1787574537.974409:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346846976 00000100:00100000:3.0:1787574537.974435:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1787574537.974442:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346846976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574537.974469:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346846976:12345-0@lo:400:kworker.0 Request processed in 29us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574537.974475:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00080000:3.0:1787574537.974489:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787574537.974511:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40423b480 x1874407346846976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574537.974521:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346846976:0@lo:400:kworker.0 00000100:00100000:3.0:1787574537.974526:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346847616:0@lo:400:kworker.0 00000100:00100000:3.0:1787574537.974544:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574537.974568:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574537.974573:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346847488:0@lo:400:kworker.0 00000100:00100000:3.0:1787574537.974591:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574537.974607:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346847488 00000100:00100000:3.0:1787574537.974609:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346847488 00000100:00100000:3.0:1787574537.974640:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1787574537.974645:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346847488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574537.974671:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346847488:12345-0@lo:400:kworker.0 Request processed in 25us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574537.974677:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00080000:3.0:1787574537.974687:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787574537.974701:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca404238380 x1874407346847488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574537.974710:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346847488:0@lo:400:kworker.0 00000100:00100000:1.0:1787574537.975771:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346846464:0@lo:38:kworker.0 00000100:00100000:1.0:1787574537.975817:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574537.975853:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346846848:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787574537.975874:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574537.975891:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346847360:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787574537.975910:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574537.975941:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346847104 00000100:00100000:1.0:1787574537.975947:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346847104 00000100:00100000:1.0:1787574537.975985:0:8619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346847616 00000100:00100000:1.0:1787574537.975988:0:8619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346847616 00000100:00100000:0.0:1787574537.978262:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787574537.978283:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346847104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574537.978362:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346847104:12345-0@lo:400:kworker.0 Request processed in 90us (4840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574537.978370:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787574537.978395:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346846848 00000100:00100000:0.0:1787574537.978401:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346846848 00000100:00100000:0.0:1787574537.978422:0:11515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346847360 00000100:00100000:0.0:1787574537.978424:0:11515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346847360 00000100:00100000:0.0:1787574537.978436:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787574537.978441:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346846848:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787574537.978454:0:11515:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787574537.978484:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346846848:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 42us (2609us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787574537.978490:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787574537.978513:0:11515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787574537.978517:0:11515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346847360:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787574537.978524:0:11515:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787574537.978544:0:11515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346847360:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 26us (2634us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787574537.978550:0:11515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787574537.978589:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346847104:0@lo:400:kworker.0 00000100:00080000:0.0:1787574537.978620:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574537.978641:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5267f0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574537.978646:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787574537.978650:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346846848:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1787574537.978659:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca53b11f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574537.978662:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787574537.978665:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346847360:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787574537.978968:0:8619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787574537.978977:0:8619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346847616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574537.979013:0:8619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346847616:12345-0@lo:400:kworker.0 Request processed in 38us (4468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574537.979019:0:8619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787574537.979544:0:10749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346846464 00000100:00100000:3.0:1787574537.979550:0:10749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346846464 00000100:00100000:3.0:1787574537.979580:0:10749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787574537.979586:0:10749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3633:x1874407346846464:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787574537.979596:0:10749:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787574537.979632:0:10749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3633:x1874407346846464:12345-0@lo:38:kworker.0 Request processed in 46us (3814us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787574537.979638:0:10749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:3.0:1787574537.979672:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca535277800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574537.979677:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787574537.979681:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346846464:0@lo:38:kworker.0 00000100:00100000:3.0:1787574537.979705:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346847616:0@lo:400:kworker.0 00000100:00080000:2.0:1787574537.986150:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574537.986161:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 216 00000100:00080000:2.0:1787574537.986169:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ca401a1d000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574537.986207:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca40429a680 x1874407346847872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574537.986277:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346847872:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787574537.986402:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574537.986476:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346846720:0@lo:400:kworker.0 00000100:00100000:1.0:1787574537.986564:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346847872 00000100:00100000:1.0:1787574537.986572:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346847872 00000100:00100000:1.0:1787574537.986615:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787574537.986623:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346847872:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787574537.986648:0:6509:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787574537.996226:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346847872:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 9592us (9813us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787574537.996270:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1787574537.998347:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574537.998360:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787574537.998380:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346847872:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1787574538.943441:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787574539.761448:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca403371de0 - data ffff9ca52772f1b0/ffff9ca403402000 00000020:01000000:1.0:1787574539.761587:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca518e4cde0 - data ffff9ca5274a21b0/ffff9ca51ea43400 00000001:00000004:1.0:1787574539.768764:0:15153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:3.0:1787574539.855337:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787574539.855346:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787574539.855362:0:15153:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ca40423b100 x1874407346845568/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787574543 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574539.855391:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787574539.858685:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787574539.858691:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1787574539.858716:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787574539.858719:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787574539.858937:0:8615:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787574539.858942:0:8615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787574539.858951:0:8615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787574539.859483:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787574539.859487:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1787574539.859497:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787574539.859499:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787574539.859772:0:9780:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787574539.859776:0:9780:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787574539.859783:0:9780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787574539.860873:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7a27 00000020:00000080:0.0:1787574539.860883:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca506ef4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787574539.861151:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca506ef4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787574539.871300:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7a3c 00000020:00000080:1.0:1787574539.871313:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca5045c3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787574539.871326:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787574539.871330:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574539.871337:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787574539.871341:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9ca52051b370) has no exports 00000020:00000080:3.0:1787574539.871606:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5045c3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1787574539.871715:0:15153:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787574539.871723:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7e72 00000020:00000080:1.0:1787574539.871727:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca403184000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787574539.871740:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787574539.871743:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574539.871752:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787574539.871754:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9ca4024c8000) has no exports 00000020:00000080:1.0:1787574539.871760:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7e6b 00000020:00000080:1.0:1787574539.871764:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca403183800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787574539.872044:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403184000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787574539.872054:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403183800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787574539.872544:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787574539.872549:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787574539.872553:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1787574539.872559:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787574539.872561:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787574539.872620:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca403185000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787574539.872737:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574539.872747:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787574539.872750:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca403183000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787574539.872753:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403183000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787574539.872757:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787574539.872901:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7d30 00000020:00000080:1.0:1787574539.872913:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca536bef800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787574539.872949:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787574539.872953:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574539.872969:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787574539.872972:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9ca5350b8000) has no exports 00000020:00000080:1.0:1787574539.872977:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7d29 00000020:00000080:1.0:1787574539.872980:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca536bef000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787574539.881301:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca536bef800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1787574539.882654:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787574539.882661:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787574539.882665:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1787574539.882672:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787574539.882674:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787574539.882723:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574539.882735:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787574539.882749:0:15153:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787574539.882757:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7be0 00000020:00000080:1.0:1787574539.882765:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca53bc3c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787574539.882771:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787574539.882779:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574539.882785:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787574539.882788:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ca52f330000) has no exports 00000020:00000080:1.0:1787574539.882795:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7bd9 00000020:00000080:1.0:1787574539.882798:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca50501c000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787574539.884225:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca536bef000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787574539.884261:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca536beb000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787574539.884271:0:38:0:(genops.c:885:class_export_put()) final put ffff9ca536bed000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787574539.884274:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca536bed000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787574539.884290:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787574539.884369:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53bc3c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787574539.884375:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50501c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787574539.914445:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787574539.914512:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787574539.914517:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787574539.914526:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787574539.914618:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574539.914659:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787574539.914690:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574539.914703:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787574539.914709:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca506ef7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787574539.914723:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca506ef7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787574539.914730:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787574539.914889:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7a43 00000020:00000080:1.0:1787574539.914896:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca5045c7000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787574539.914983:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca50501e800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787574539.914990:0:38:0:(genops.c:885:class_export_put()) final put ffff9ca50501d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787574539.914992:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50501d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787574539.915002:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787574539.915153:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787574539.915158:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574539.915164:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787574539.915168:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9ca52051cd28) has no exports 00000020:00000080:1.0:1787574539.915187:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574539.915190:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787574539.915194:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7a4a 00000020:00000080:1.0:1787574539.915199:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca5045c6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787574539.915225:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5045c7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787574539.915229:0:38:0:(genops.c:885:class_export_put()) final put ffff9ca506ef3800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787574539.915230:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca506ef3800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787574539.915359:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787574539.915527:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5045c6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1787574539.915552:0:15153:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca5109bd800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787574539.915556:0:15153:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca5109bd800 3 00000020:01000004:1.0:1787574539.915559:0:15153:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ca5109bd800 from lustre-MDT0000 00000020:00000080:1.0:1787574539.915580:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574539.915584:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787574539.915588:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca506ef5800/lustre-MDT0000_UUID 00000020:00000080:1.0:1787574539.915590:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca506ef5800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787574539.915596:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787574539.915692:0:15153:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787574539.915704:0:15153:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787574539.915707:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787574539.915710:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574539.915713:0:15153:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787574539.915719:0:15153:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9ca534a3e000 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787574539.915725:0:15153:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9ca5205199b8) has exports, disconnecting them 00000020:00080000:1.0:1787574539.915729:0:15153:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ca534a3e000), last request at 1787574234 00000020:00000080:1.0:1787574539.915743:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb79e8 00000020:00010000:1.0:1787574539.915747:0:15153:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ca534a3e000: total 0 00000100:00080000:1.0:1787574539.915751:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9ca52b617000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787574539.915770:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca534a3e000): rc 0 00000020:00080000:1.0:1787574539.915781:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9ca5205199b8) has no exports 00000020:00010000:3.0:1787574539.915899:0:6498:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ca534a3e000: total 0 00010000:00010000:3.0:1787574539.915924:0:6498:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ca534a3e000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787574539.915953:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82c00/0xd18a1efeeddb7ee9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7ee2 expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916276:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb8197 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb8190 expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916287:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75800/0xd18a1efeeddb8189 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb8182 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916296:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be99c00/0xd18a1efeeddb7f59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7f52 expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916307:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c11400/0xd18a1efeeddb7ef7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7ef0 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916331:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb81a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb819e expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916343:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75400/0xd18a1efeeddb7e09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7e02 expref: 8 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916353:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c10400/0xd18a1efeeddb7f05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7efe expref: 7 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916363:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be99000/0xd18a1efeeddb7f13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7f0c expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916372:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be99200/0xd18a1efeeddb7f21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7f1a expref: 5 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916382:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500031c00/0xd18a1efeeddb7ae4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7add expref: 4 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916393:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca509e19c00/0xd18a1efeeddb7af2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7aeb expref: 3 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916404:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca535c11e00/0xd18a1efeeddb7f2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb7f28 expref: 2 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574539.916414:0:6498:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ca534a3e000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1787574539.916430:0:6498:0:(genops.c:885:class_export_put()) final put ffff9ca534a3e000/61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1 00010000:00010000:3.0:1787574539.916440:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574539.916442:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574539.916443:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787574539.916472:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca534a3e000/61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1 for MGS 00000020:00000080:3.0:1787574539.916497:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca52b617000 for MGS 00000100:00100000:0.0:1787574539.919718:0:6504:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ca518a5b000:6504] 2 exiting: rc = 0 00000100:00100000:0.0:1787574539.920191:0:6503:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ca5030c4400:6503] 1 exiting: rc = 0 00000100:00100000:0.0:1787574539.920283:0:6501:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ca50304ce00:6501] 0 exiting: rc = 1 00000100:00100000:3.0:1787574539.920406:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920415:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920421:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920427:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920432:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920439:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920444:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920451:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920469:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920475:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920482:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920488:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920494:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920500:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920506:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920512:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920519:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920526:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920532:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920538:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920544:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920550:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920556:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920561:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920567:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920573:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920579:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920586:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920592:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920597:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920603:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920620:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920626:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920645:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920651:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920656:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920661:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920666:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920672:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920678:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920683:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920689:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920705:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920711:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920717:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920722:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920728:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920734:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920739:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920745:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920751:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920756:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920762:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920767:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920773:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920778:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920783:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920789:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920794:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920799:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920804:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920810:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920825:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574539.920830:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1787574539.922069:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca4022a6540 - data ffff9ca52772bca8/ffff9ca4033e3800 00000020:01000000:3.0:1787574539.922346:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca534b521e0 - data ffff9ca509294ca8/ffff9ca50554d000 00000020:00000080:3.0:1787574539.922888:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb79cc 00000020:00000080:3.0:1787574539.922902:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca518c0e800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787574539.922913:0:15153:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca5109bd800 from MGS, refs=2 00000020:01000004:3.0:1787574539.922922:0:15153:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca5109bd800 2 00000020:01000004:3.0:1787574539.922926:0:15153:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ca5109bd800 from MGS 00000020:00000080:3.0:1787574539.922949:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574539.922957:0:15153:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787574539.922959:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca506d96800/MGS 00000020:00000080:3.0:1787574539.922961:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca506d96800/MGS for MGS 00000020:01000000:3.0:1787574539.922967:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787574539.923110:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787574539.923114:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574539.923119:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787574539.923125:0:15153:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ca5350c8000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787574539.923130:0:15153:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9ca5350b99b8) has exports, disconnecting them 00000020:00080000:3.0:1787574539.923135:0:15153:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ca5350c8000), last request at 1787574235 00000020:00000080:3.0:1787574539.923138:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7a97 00000020:00080000:3.0:1787574539.923147:0:15153:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca5350c8000): rc 0 00000020:00000080:3.0:1787574539.923152:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca5350c8000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787574539.923460:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca518c0e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787574539.923471:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350c8000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787574539.933351:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787574539.933360:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787574539.933375:0:15153:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787574539.933382:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787574539.933414:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca5350cb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787574539.933582:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574539.933590:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787574539.933595:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca52675b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787574539.933600:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca52675b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787574539.933605:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787574539.933811:0:15153:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca5109bd800 1 00000020:00000080:0.0:1787574539.933828:0:15153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb79be 00000020:00000080:0.0:1787574539.933834:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca506d90000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787574539.933844:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787574539.933852:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca506d90000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787574539.933861:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574539.933866:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787574539.933870:0:15153:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9ca5050d0000) has no exports 00010000:00010000:3.0:1787574539.983684:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787574539.993064:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574539.993076:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787574539.993082:0:15153:0:(genops.c:885:class_export_put()) final put ffff9ca5109bb000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787574539.993087:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5109bb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787574539.993093:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787574539.993213:0:15153:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ca5109b8800 00000020:02000400:0.0:1787574539.993552:0:15153:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787574540.978802:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574541.052127:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346848000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574541.052195:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574541.052313:0:10243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346848000 00000100:00100000:2.0:1787574541.052322:0:10243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346848000 00000100:00100000:2.0:1787574541.052393:0:10243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787574541.052404:0:10243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346848000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574541.052433:0:10243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1787574541.054485:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574541.059960:0:10243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346848000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7547us (7753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574541.059976:0:10243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787574541.069462:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346848000:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1787574541.434922:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787574542.009225:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574543.032837:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574543.089438:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346848128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574543.089501:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574543.089596:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346848128 00000100:00100000:3.0:1787574543.089602:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346848128 00000100:00100000:3.0:1787574543.089680:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787574543.089690:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346848128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574543.089716:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787574543.089762:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346848128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574543.089767:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787574543.089817:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346848128:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787574543.089847:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574543.089849:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787574543.089852:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca535277800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574543.089855:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1787574543.089858:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787574543.089861:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ca535277800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574543.089874:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5d880 x1874407346848384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574543.089884:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574543.089886:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787574543.089887:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca5267f0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574543.089890:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1787574543.089893:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787574543.089896:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ca5267f0800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574543.089907:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5ed80 x1874407346848512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574543.089915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574543.089919:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787574543.089920:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574543.089923:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1787574543.089925:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787574543.089928:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ca401a1d000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574543.089937:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5ca80 x1874407346848640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574543.089975:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574543.089979:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787574543.089980:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca53b11f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574543.089983:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1787574543.089986:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787574543.089989:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ca53b11f800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574543.089999:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5e680 x1874407346849024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574543.090025:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346848384:0@lo:38:kworker.0 00000100:00100000:3.0:1787574543.090054:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574543.090073:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346848512:0@lo:38:kworker.0 00000100:00100000:3.0:1787574543.090095:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574543.090105:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346848640:0@lo:38:kworker.0 00000100:00100000:3.0:1787574543.090115:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574543.090124:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346849024:0@lo:38:kworker.0 00000100:00100000:3.0:1787574543.090134:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574543.090150:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346848768:0@lo:400:kworker.0 00000100:00100000:3.0:1787574543.090162:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574543.090176:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574543.090181:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346848896:0@lo:400:kworker.0 00000100:00100000:3.0:1787574543.090202:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574543.090224:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346848384 00000100:00100000:3.0:1787574543.090228:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346848384 00000100:00100000:3.0:1787574543.090265:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787574543.090274:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346848384:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787574543.090288:0:6515:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787574543.090313:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346848384:12345-0@lo:38:kworker.0 Request processed in 38us (259us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787574543.090317:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787574543.090329:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346848512 00000100:00100000:3.0:1787574543.090332:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346848512 00000100:00100000:3.0:1787574543.090342:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346848640 00000100:00100000:3.0:1787574543.090343:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346848640 00000100:00100000:3.0:1787574543.090347:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346849024 00000100:00100000:3.0:1787574543.090349:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346849024 00000100:00100000:3.0:1787574543.090352:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346848768 00000100:00100000:3.0:1787574543.090353:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346848768 00000100:00100000:3.0:1787574543.090365:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1787574543.090368:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346848768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574543.090390:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346848768:12345-0@lo:400:kworker.0 Request processed in 22us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574543.090394:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1787574543.090400:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787574543.090403:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3633:x1874407346848512:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787574543.090408:0:8610:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787574543.090420:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3633:x1874407346848512:12345-0@lo:38:kworker.0 Request processed in 17us (325us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787574543.090424:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787574543.090429:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787574543.090431:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3633:x1874407346848640:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787574543.090436:0:8610:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787574543.090455:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3633:x1874407346848640:12345-0@lo:38:kworker.0 Request processed in 23us (339us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787574543.090459:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787574543.090466:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787574543.090468:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3633:x1874407346849024:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787574543.090473:0:8610:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787574543.090483:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3633:x1874407346849024:12345-0@lo:38:kworker.0 Request processed in 15us (349us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787574543.090487:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:3.0:1787574543.090508:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9ca53be5e300 x1874407346848768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574543.090515:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346848768:0@lo:400:kworker.0 00000100:00080000:3.0:1787574543.090529:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca535277800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574543.090531:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787574543.090533:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346848384:0@lo:38:kworker.0 00000100:00080000:3.0:1787574543.090538:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5267f0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574543.090539:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787574543.090541:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346848512:0@lo:38:kworker.0 00000100:00080000:3.0:1787574543.090545:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574543.090547:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787574543.090548:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346848640:0@lo:38:kworker.0 00000100:00080000:3.0:1787574543.090551:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca53b11f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574543.090553:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787574543.090559:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346849024:0@lo:38:kworker.0 00000100:00100000:3.0:1787574543.090572:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346849152:0@lo:400:kworker.0 00000100:00100000:3.0:1787574543.090588:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574543.090598:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574543.090600:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346848256:0@lo:400:kworker.0 00000400:00000100:3.0:1787574543.090611:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874407346848256 offset 0 length 224: 4 00000100:00100000:3.0:1787574543.090626:0:8610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346849152 00000100:00100000:3.0:1787574543.090629:0:8610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346849152 00000100:00100000:3.0:1787574543.090650:0:8610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1787574543.090655:0:8610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346849152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574543.090699:0:8610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346849152:12345-0@lo:400:kworker.0 Request processed in 44us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574543.090705:0:8610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00080000:3.0:1787574543.090722:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9ca53be5c700 x1874407346849152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574543.090728:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346849152:0@lo:400:kworker.0 00000100:00080000:0.0:1787574543.091034:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574543.091038:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574543.091052:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346848896 00000100:00100000:0.0:1787574543.091059:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346848896 00000100:00100000:0.0:1787574543.091091:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787574543.091097:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346848896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574543.091125:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346848896:12345-0@lo:400:kworker.0 Request processed in 29us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574543.091129:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787574543.091146:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346848896:0@lo:400:kworker.0 00000100:00080000:1.0:1787574543.091192:0:6505:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787574544.049617:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787574544.552433:0:15354:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787574544.572472:0:15354:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787574544.572518:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.572532:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.572541:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.572563:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.572699:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787574544.572704:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787574544.572725:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787574544.572730:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787574544.572735:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787574544.572741:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9ca5267f0800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787574544.572745:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787574544.572747:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787574544.572749:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787574544.573397:0:13730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574544.573406:0:13730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574544.573414:0:13730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574544.573417:0:13730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574544.573427:0:13730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574544.573435:0:13730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574544.573440:0:13730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787574544.573442:0:13730:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787574544.573445:0:13730:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787574544.573480:0:13730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574544.573486:0:13730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574544.573520:0:13730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574544.573527:0:13730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83a00/0xd18a1efeeddb7f1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f21 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574544.573539:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574544.573541:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574544.573542:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574544.573608:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574544.573765:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346849280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574544.573834:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574544.573925:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346849280 00000100:00100000:2.0:1787574544.573941:0:7451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346849280 00000100:00100000:2.0:1787574544.573984:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574544.573992:0:7451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52b68ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3634:x1874407346849280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787574544.573998:0:7451:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787574544 with bad export cookie 15098914780974119400 00010000:00010000:3.0:1787574544.576013:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576029:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576036:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576043:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576067:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574544.576074:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576094:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576100:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576106:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576120:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787574544.576126:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576131:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576137:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576142:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576154:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787574544.576166:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787574544.576172:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576178:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82800 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574544.576186:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576193:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574544.576201:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574544.576207:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787574544.576209:0:6497:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1787574544.576237:0:6497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576269:0:6497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574544.576286:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.576292:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82800/0xd18a1efeeddb7f28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7f2f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.576718:0:13731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574544.576724:0:13731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.576731:0:13731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75e00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574544.576734:0:13731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.576740:0:13731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574544.576746:0:13731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574544.576751:0:13731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787574544.576753:0:13731:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787574544.576755:0:13731:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787574544.576775:0:13731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.576791:0:13731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574544.576798:0:13731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.576805:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb7e02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7e09 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.576823:0:13731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574544.576827:0:13731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.576833:0:13731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574544.576836:0:13731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.576842:0:13731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574544.576849:0:13731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574544.576854:0:13731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787574544.576856:0:13731:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787574544.576858:0:13731:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787574544.576871:0:13731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.576877:0:13731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574544.576892:0:13731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.576909:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb819e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb81a5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.576919:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574544.576920:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574544.576922:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574544.576941:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346849408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574544.577005:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574544.577052:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574544.577057:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346849536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574544.577078:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574544.577107:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346849664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574544.577127:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574544.577156:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346849408 00000100:00100000:0.0:1787574544.577161:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346849408 00000100:00100000:0.0:1787574544.577187:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346849536 00000100:00100000:0.0:1787574544.577190:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346849536 00000100:00100000:0.0:1787574544.577201:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346849664 00000100:00100000:0.0:1787574544.577203:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346849664 00000100:00100000:0.0:1787574544.577213:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787574544.577221:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3636:x1874407346849408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787574544.577227:0:6494:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787574544 with bad export cookie 15098914780974119400 00000100:00100000:0.0:1787574544.577287:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3636:x1874407346849408:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (281us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787574544.577294:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787574544.577420:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574544.581253:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574544.581257:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574544.581260:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574544.581287:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca54216d600/0xd18a1efeeddb7aeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574544.581325:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787574544.581336:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3636:x1874407346849536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787574544.581343:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787574544 with bad export cookie 15098914780974119400 00010000:00010000:3.0:1787574544.581356:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca54216d600/0xd18a1efeeddb7aeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.581363:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca54216d600/0xd18a1efeeddb7aeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.581383:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca54216d600/0xd18a1efeeddb7aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574544.581409:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787574544.581416:0:15354:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1787574544.581419:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000100:00100000:1.0:1787574544.581426:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3636:x1874407346849536:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (4347us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787574544.581432:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787574544.581453:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000020:01000004:3.0:1787574544.581454:0:15354:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000100:00100000:1.0:1787574544.581457:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3634:x1874407346849664:12345-0@lo:103:ldlm_bl.0 00000020:01000000:3.0:1787574544.581458:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00010000:00020000:1.0:1787574544.581461:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787574544 with bad export cookie 15098914780974119400 00000020:00000080:3.0:1787574544.581462:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574544.581467:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787574544.581472:0:15354:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9ca4033d9000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787574544.581477:0:15354:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9ca4010c4800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787574544.581482:0:15354:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9ca53b1499b8) has exports, disconnecting them 00000020:00080000:3.0:1787574544.581486:0:15354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ca4033d9000), last request at 1787574543 00000100:00100000:1.0:1787574544.581491:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3634:x1874407346849664:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (4363us total) trans 0 rc -107/-107 00000020:00000080:3.0:1787574544.581493:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7dca 00000100:00100000:1.0:1787574544.581496:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787574544.581508:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9ca4033da000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1787574544.581543:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787574544.581547:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9ca518092800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787574544.581550:0:3634:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00080000:3.0:1787574544.581558:0:15354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca4033d9000): rc 0 00000020:00000080:3.0:1787574544.581560:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca4033d9000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787574544.581570:0:15354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ca4010c4800), last request at 1787574543 00010000:00010000:0.0:1787574544.581636:0:13731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574544.581642:0:13731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca54216d600/0xd18a1efeeddb7aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.581664:0:13731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca54216d600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574544.581668:0:13731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca54216d600/0xd18a1efeeddb7aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.581676:0:13731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca54216d600/0xd18a1efeeddb7aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574544.581684:0:13731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca54216d600/0xd18a1efeeddb7aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574544.581689:0:13731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787574544.581692:0:13731:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787574544.581694:0:13731:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:3.0:1787574544.581723:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7ca4 00000100:00080000:3.0:1787574544.581729:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9ca4010c0800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787574544.581739:0:15354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca4010c4800): rc 0 00000020:00000080:3.0:1787574544.581742:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca4010c4800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787574544.581748:0:15354:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa7bcc151fae0 00000100:00080000:3.0:1787574544.581766:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787574544.581773:0:15354:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9ca40429aa00 x1874407346846080/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787574553 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574544.581795:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1787574544.586613:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787574544.586634:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9ca535277800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1787574544.589468:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574544.591463:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787574544.591470:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1787574544.591485:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787574544.591540:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787574544.591571:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9ca535270000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787574544.591589:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787574544.591591:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1787574544.591599:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787574544.591691:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346849792:0@lo:9:umount.0 00000100:00100000:3.0:1787574544.591760:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787574544.591809:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787574544.591819:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9ca403555000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787574544.591834:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346849920:0@lo:9:umount.0 00000100:00100000:3.0:1787574544.591855:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787574544.591897:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ca53b1499b8) has no exports 00000100:00100000:2.0:1787574544.595834:0:7451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52b68ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3634:x1874407346849280:12345-0@lo:103:ldlm_bl.0 Request processed in 21835us (21994us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787574544.595847:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787574544.600807:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787574544.623292:0:3634:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.140@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787574544.623298:0:3634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787574544.623308:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53be5c380 x1874407346848256/t0(0) o400->MGC192.168.202.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787574559 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574544.623324:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca404299500 x1874407346849280/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787574560 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574544.624095:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53be5c700 x1874407346849408/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787574560 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574544.624104:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca404239500 x1874407346849536/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787574560 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574544.624113:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca40423ad80 x1874407346849664/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787574560 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787574544.624696:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787574544.624702:0:3634:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787574544.624703:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1787574544.628846:0:13731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca54216d600/0xd18a1efeeddb7aeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.628861:0:13731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574544.628877:0:13731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca54216d600/0xd18a1efeeddb7aeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.628884:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca54216d600/0xd18a1efeeddb7aeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb7af2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574544.628911:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574544.628913:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574544.628915:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574544.629465:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346849792 00000100:00100000:3.0:1787574544.629474:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346849792 00000100:00100000:3.0:1787574544.629512:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346849920 00000100:00100000:3.0:1787574544.629514:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346849920 00000100:00100000:3.0:1787574544.629533:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787574544.629542:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874407346849792:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787574544.629564:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7cf1 00000100:00080000:3.0:1787574544.629574:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574544.629705:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787574544.629880:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3633:x1874407346849792:12345-0@lo:9:umount.0 Request processed in 337us (38120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574544.629887:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787574544.629901:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787574544.629908:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874407346849920:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787574544.629918:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7e41 00000100:00080000:3.0:1787574544.629923:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9ca4033ba800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574544.629942:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787574544.630005:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3633:x1874407346849920:12345-0@lo:9:umount.0 Request processed in 97us (38148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574544.630011:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000020:00000080:3.0:1787574544.630039:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033d9000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787574544.630205:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4010c4800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787574544.630228:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4033da000 for lustre-MDT0001 00000020:00000080:3.0:1787574544.630232:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4010c0800 for lustre-MDT0001 00010000:00010000:3.0:1787574544.630270:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574544.630426:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca403555000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787574544.630439:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787574544.630442:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787574544.630447:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346849920:0@lo:9:umount.0 00000100:00080000:3.0:1787574544.630461:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca535270000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787574544.630468:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787574544.630470:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787574544.630472:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346849792:0@lo:9:umount.0 00010000:00010000:3.0:1787574544.630494:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574544.630519:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787574544.632755:0:3636:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9ca518092800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787574544.634232:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346849408:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787574544.634232:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9ca518092800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574544.634251:0:3634:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 174 00000100:00080000:1.0:1787574544.634259:0:3634:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9ca518092800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574544.634278:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:0:1874407346850048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574544.634286:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346846080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574544.634342:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca4040a7800 x1874407346850176/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787574544.634380:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346849280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574544.634390:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346848256:0@lo:400:kworker.0 00000100:00100000:2.0:1787574544.634394:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3633:1874407346850176:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:1.0:1787574544.634404:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3634:1874407346849664:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1787574544.634440:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874407346850176 offset 0 length 520: 4 00000100:00100000:3.0:1787574544.637042:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3636:1874407346849536:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787574544.653883:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ca53b1499b8) has no exports 00000020:01000000:1.0:1787574544.730020:0:15354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca4022a6cc0 - data ffff9ca5276bee58/ffff9ca4033e1400 00000020:01000000:1.0:1787574544.730177:0:15354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca5351c8360 - data ffff9ca527476bd0/ffff9ca541ff2000 00000001:00000004:3.0:1787574544.745236:0:15354:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1787574544.808208:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787574544.808216:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1787574544.808234:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787574544.811576:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787574544.811583:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1787574544.811921:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787574544.811925:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787574544.815523:0:8608:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787574544.815530:0:8608:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1787574544.815542:0:8608:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787574544.816934:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787574544.816941:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1787574544.816956:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787574544.816958:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787574544.817230:0:9776:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787574544.817234:0:9776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1787574544.817263:0:9776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787574544.819209:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7b0e 00000020:00000080:0.0:1787574544.819222:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca506ef6800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787574544.819851:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca506ef6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787574544.820815:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7b23 00000020:00000080:0.0:1787574544.820824:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca518091000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787574544.820840:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1787574544.820845:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574544.820852:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787574544.820856:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9ca5050d3370) has no exports 00000004:01000000:0.0:1787574544.821021:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787574544.821029:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca518091000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1787574544.821030:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7e2c 00000020:00000080:0.0:1787574544.821034:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca40270f800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787574544.821044:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787574544.821047:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574544.821048:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca40270f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787574544.821055:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787574544.821058:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9ca4032ccd28) has no exports 00000020:00000080:0.0:1787574544.821063:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7e25 00000020:00000080:0.0:1787574544.821066:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca403553800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787574544.821114:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403553800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787574544.821431:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787574544.821436:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787574544.821440:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1787574544.821445:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787574544.821447:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787574544.821487:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574544.821501:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787574544.821506:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7cea 00000020:00000080:0.0:1787574544.821510:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca401a19800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787574544.821513:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787574544.821516:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574544.821519:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787574544.821521:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9ca402223370) has no exports 00000020:00000080:0.0:1787574544.821525:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7ce3 00000020:00000080:0.0:1787574544.821527:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca535271800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787574544.821636:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca403555000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787574544.821643:0:8:0:(genops.c:885:class_export_put()) final put ffff9ca4033dc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787574544.821645:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033dc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787574544.821660:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787574544.821734:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca401a19800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787574544.821739:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca535271800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787574544.821896:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787574544.821900:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787574544.821902:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1787574544.821905:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787574544.821906:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787574544.821937:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca535270000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787574544.821940:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574544.821945:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787574544.821948:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca401a18800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787574544.821950:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca401a18800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1787574544.821954:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1787574544.822003:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787574544.822007:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7b46 00000020:00000080:0.0:1787574544.822010:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca5350a5800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787574544.822023:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787574544.822026:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574544.822029:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787574544.822032:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ca535080000) has no exports 00000020:00000080:0.0:1787574544.822035:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7b3f 00000020:00000080:0.0:1787574544.822037:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca535275000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787574544.822234:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350a5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787574544.822259:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca535275000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787574544.827584:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1787574544.827594:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574544.827598:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787574544.827631:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787574544.827701:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574544.827712:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787574544.827740:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574544.827744:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787574544.827749:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca5267f5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787574544.827754:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5267f5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787574544.827767:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787574544.830424:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7b2a 00000020:00000080:1.0:1787574544.830440:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca518092000/lustre-MDD0001_UUID 00000020:01000000:1.0:1787574544.830449:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1787574544.830454:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574544.830463:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787574544.830467:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9ca53b14b370) has no exports 00000020:00000080:1.0:1787574544.830492:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574544.830497:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1787574544.830501:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7b31 00000020:00000080:1.0:1787574544.830506:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca518091800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1787574544.830514:0:15354:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca526758000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787574544.830517:0:15354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca526758000 2 00000020:01000004:1.0:1787574544.830521:0:15354:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ca526758000 from lustre-MDT0001 00000020:00000080:1.0:1787574544.830537:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574544.830540:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787574544.830543:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca506ef2000/lustre-MDT0001_UUID 00000020:00000080:1.0:1787574544.830545:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca506ef2000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787574544.830555:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1787574544.830599:0:15354:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1787574544.831082:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787574544.831087:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574544.831091:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787574544.831097:0:15354:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9ca5350a0800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787574544.831114:0:15354:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9ca52f333370) has exports, disconnecting them 00000020:00080000:1.0:1787574544.831119:0:15354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9ca5350a0800), last request at 1787574255 00000020:00000080:1.0:1787574544.831123:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7b85 00000020:00080000:1.0:1787574544.831139:0:15354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca5350a0800): rc 0 00000020:00000080:1.0:1787574544.831142:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca5350a0800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787574544.835178:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca535277800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787574544.835197:0:8:0:(genops.c:885:class_export_put()) final put ffff9ca535272000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787574544.835200:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca535272000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787574544.835208:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787574544.835359:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca518092000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787574544.835375:0:8:0:(genops.c:885:class_export_put()) final put ffff9ca5267f1800/lustre-MDD0001_UUID 00000020:00000080:3.0:1787574544.835377:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5267f1800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787574544.835381:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787574544.835557:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca518091800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787574544.835563:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350a0800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1787574544.887317:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787574544.887326:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787574544.887330:0:15354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787574544.887337:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787574544.887369:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca5267f0800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787574544.887541:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574544.887549:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787574544.887554:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca5350a7000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787574544.887558:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350a7000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787574544.887569:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1787574544.887648:0:15354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca526758000 1 00000020:00000080:3.0:1787574544.887664:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7ac1 00000020:00000080:3.0:1787574544.887671:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca52675f000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1787574544.887679:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1787574544.887687:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca52675f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787574544.887696:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574544.887701:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787574544.887705:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ca5350bb370) has no exports 00000020:00000080:3.0:1787574545.060982:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574545.060995:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787574545.061001:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca52675c000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787574545.061005:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca52675c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787574545.061016:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787574545.061139:0:15354:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ca52675e800 00000020:01000000:3.0:1787574545.061165:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787574545.061168:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574545.061173:0:15354:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787574545.061177:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9ca5050d19b8) has no exports 00000100:00100000:1.0:1787574545.062905:0:8610:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ca402216800:8610] 3 exiting: rc = 0 00000100:00100000:1.0:1787574545.064816:0:6510:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ca50c0e9e00:6510] 1 exiting: rc = 0 00000100:00100000:0.0:1787574545.067953:0:11515:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9ca53bd95c00:11515] 4 exiting: rc = 0 00000100:00100000:3.0:1787574545.070021:0:6511:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ca5072f2a00:6511] 2 exiting: rc = 0 00000100:00100000:3.0:1787574545.070145:0:6509:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ca51802cc00:6509] 0 exiting: rc = 1 00000100:00100000:3.0:1787574545.070209:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070218:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070224:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070229:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070234:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070709:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070717:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070723:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070729:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070735:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070741:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070746:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070751:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070758:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070763:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070769:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070775:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070781:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070787:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070793:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070799:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070803:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070808:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070814:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070819:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070825:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070831:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070836:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.070841:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071313:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071319:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071324:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071329:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071334:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071340:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071346:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071351:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071356:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071361:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071367:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071372:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071377:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071382:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071387:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071392:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071397:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071402:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071407:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071412:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071417:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071422:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071428:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071433:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071439:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071444:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071450:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071455:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071461:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071466:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071471:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071476:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071481:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071486:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.071502:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574545.075788:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ca5349f5e00:6513] 1 exiting: rc = 0 00000100:00100000:0.0:1787574545.078424:0:6512:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ca5186b3200:6512] 0 exiting: rc = 1 00010000:00010000:0.0:1787574545.078547:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574545.078622:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078631:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078638:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078644:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078660:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078666:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078673:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078679:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078685:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078691:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078696:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078702:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078708:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078713:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078718:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078723:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078728:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078734:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078738:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078744:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078750:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078755:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078760:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078766:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078771:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078776:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078782:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078786:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078792:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078797:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078802:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078808:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078813:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078818:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078823:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078837:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078842:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078847:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.078852:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079231:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079258:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079265:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079270:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079275:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079279:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079284:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079289:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079293:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079299:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079303:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079308:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079314:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079318:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079323:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079328:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079332:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079337:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079342:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079348:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079353:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079358:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079363:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079368:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.079373:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574545.083202:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ca5203f1200:6515] 1 exiting: rc = 0 00000100:00100000:1.0:1787574545.088427:0:10749:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9ca535340800:10749] 2 exiting: rc = 0 00000100:00100000:1.0:1787574545.090102:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ca50507ae00:6514] 0 exiting: rc = 1 00000100:00100000:3.0:1787574545.090982:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091210:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091333:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091342:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091348:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091355:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091376:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091383:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091389:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091397:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091403:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091419:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091426:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091432:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091438:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091443:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091450:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091455:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091460:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091465:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091470:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091475:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091482:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091502:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091510:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091516:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091521:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091526:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091531:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091537:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091542:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091548:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091555:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091567:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091575:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091581:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091587:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091593:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091599:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091620:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091627:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091639:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091644:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091663:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091672:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091678:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091683:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091688:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091694:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091699:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091705:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091725:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091733:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091739:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091745:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091752:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091757:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091765:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091771:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091780:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091786:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091792:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091799:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.091805:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574545.124114:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ca534a1f200:6516] 0 exiting: rc = 1 00000100:00100000:0.0:1787574545.124333:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ca5203f1a00:6517] 1 exiting: rc = 0 00000100:00100000:3.0:1787574545.125376:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125385:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125390:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125396:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125401:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125406:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125411:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125416:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125420:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125425:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125430:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125435:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125453:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125458:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125463:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125468:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125472:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125477:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125481:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125486:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125490:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125495:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125498:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125503:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125507:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125511:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125516:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125520:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125524:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125529:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125533:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125538:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125542:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125546:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125550:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125554:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125559:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125564:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125569:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125574:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125579:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125584:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125588:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125593:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125598:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125603:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125609:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125620:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125624:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125629:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125633:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125638:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125643:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125659:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125666:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125671:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125677:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125682:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125687:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125691:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125695:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125700:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125705:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.125709:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574545.130062:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ca510164c00:6519] 1 exiting: rc = 0 00000100:00100000:1.0:1787574545.131007:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ca510165800:6518] 0 exiting: rc = 1 00000100:00100000:3.0:1787574545.131980:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.131988:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.131993:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.131999:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132005:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132010:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132016:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132020:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132025:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132031:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132036:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132041:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132046:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132052:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132057:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132062:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132067:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132072:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132104:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132110:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132114:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132119:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132123:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132128:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132133:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132138:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132143:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132149:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132153:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132158:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132163:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132168:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132173:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132179:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132185:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132189:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132194:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132200:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132205:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132210:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132215:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132220:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132225:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132231:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132236:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132524:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132530:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132535:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132539:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132543:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132547:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132552:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132557:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132570:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132576:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132582:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132587:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132592:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132597:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132601:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132606:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132611:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132617:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.132622:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574545.134040:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ca5203f0c00:6520] 0 exiting: rc = 1 00000100:00100000:0.0:1787574545.135361:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ca510e50e00:6521] 1 exiting: rc = 0 00000100:00100000:3.0:1787574545.137370:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137379:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137384:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137389:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137394:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137399:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137404:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137409:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137413:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137418:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137423:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137428:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137434:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137439:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137443:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137448:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137453:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137457:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137462:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137467:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137471:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137476:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137481:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137486:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137507:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137513:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137517:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137522:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137526:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137532:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137538:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137543:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137548:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137553:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137560:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137565:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137570:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137575:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137580:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137584:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137589:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137594:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137598:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137603:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137609:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137614:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137618:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137623:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137628:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137632:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137637:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137642:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137657:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137663:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137669:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137673:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137678:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137683:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137688:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137701:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137706:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137710:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137714:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.137719:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574545.141424:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ca510e57c00:6522] 0 exiting: rc = 1 00000100:00100000:1.0:1787574545.141640:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ca51ebdf000:6523] 1 exiting: rc = 0 00000100:00100000:1.0:1787574545.141853:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ca510e57400:6524] 2 exiting: rc = 0 00000100:00100000:3.0:1787574545.143116:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143125:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143130:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143136:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143142:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143147:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143154:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143161:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143168:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143173:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143179:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143185:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143190:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143197:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143220:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143226:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143231:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143305:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143313:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143318:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143323:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143328:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143334:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143340:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143345:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143351:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143357:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143362:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143367:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143373:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143395:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143400:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143406:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143411:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143417:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143423:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143430:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143436:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143454:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143461:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143466:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143471:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143476:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143480:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143485:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143490:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143495:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143500:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143506:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143511:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143517:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143522:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143527:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143532:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143537:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143542:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143547:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143552:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143558:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143563:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143569:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143574:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143580:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574545.143585:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787574545.154028:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574545.154054:0:15354:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787574545.154059:0:15354:0:(genops.c:885:class_export_put()) final put ffff9ca518096000/MDS_uuid 00000020:00000080:3.0:1787574545.154064:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca518096000/MDS_uuid for MDS 00000020:01000000:3.0:1787574545.154074:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787574545.154223:0:15354:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1787574546.103442:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574547.121640:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574548.153540:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574548.209341:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574548.209353:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574548.209356:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574548.209359:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787574548.209363:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574548.209371:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1787574548.209377:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787574548.209384:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ca401a1d000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574548.209422:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5f100 x1874407346850304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574548.209476:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574548.209480:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787574548.209481:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca53b11f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574548.209485:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1787574548.209488:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787574548.209491:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ca53b11f800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574548.209503:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5df80 x1874407346850560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574548.209541:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346850432:0@lo:400:kworker.0 00000400:00000100:3.0:1787574548.209605:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346850432 offset 0 length 224: 4 00000100:00100000:3.0:1787574548.209668:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574548.209674:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346850688:0@lo:400:kworker.0 00000400:00000100:3.0:1787574548.209692:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346850688 offset 0 length 224: 4 00000100:00100000:2.0:1787574548.213868:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346850304:0@lo:38:kworker.0 00000400:00000100:2.0:1787574548.213931:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346850304 offset 0 length 520: 4 00000100:00100000:2.0:1787574548.213977:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346850560:0@lo:38:kworker.0 00000400:00000100:2.0:1787574548.213994:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346850560 offset 0 length 520: 4 00000020:01000004:2.0:1787574549.048096:0:15555:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787574549.066171:0:15555:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787574549.066230:0:15555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574549.066262:0:15555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574549.066269:0:15555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574549.066276:0:15555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574549.066311:0:15555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787574549.066317:0:15555:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787574549.066340:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787574549.066350:0:15555:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53be5f100 x1874407346850304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787574568 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574549.066367:0:15555:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787574549.066372:0:15555:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787574549.066378:0:15555:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787574549.066383:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787574549.066387:0:15555:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53be5f100 x1874407346850304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787574568 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574549.066393:0:15555:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787574549.066396:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:0.0:1787574549.066861:0:13731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574549.066870:0:13731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574549.066878:0:13731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be98400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574549.066881:0:13731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574549.066890:0:13731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574549.066897:0:13731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574549.066903:0:13731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787574549.066906:0:13731:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787574549.066908:0:13731:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787574549.066923:0:13731:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca518092800 00010000:00010000:0.0:1787574549.066927:0:13731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574549.066934:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be98400/0xd18a1efeeddb7efe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb7f05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574549.066947:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574549.066949:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574549.066950:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574549.069203:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346850304:0@lo:38:kworker.0 00000100:00080000:0.0:1787574549.070763:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787574549.070779:0:15555:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53be5ea00 x1874407346850432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574564 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574549.070794:0:15555:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787574549.070799:0:15555:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787574549.070823:0:15555:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787574549.071153:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346850432:0@lo:400:kworker.0 00000100:00100000:2.0:1787574549.072004:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1874407346850816:0@lo:39:umount.0 00000400:00000100:2.0:1787574549.072057:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346850816 offset 0 length 224: 4 00010000:00010000:3.0:1787574549.169459:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574549.233504:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787574549.233514:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574549.233517:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787574549.233521:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787574549.233752:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574549.233772:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346850944:0@lo:400:kworker.0 00000400:00000100:3.0:1787574549.233830:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346850944 offset 0 length 224: 4 00010000:00010000:3.0:1787574550.193486:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787574550.774314:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787574550.774324:0:8419:0:(genops.c:885:class_export_put()) final put ffff9ca401a1b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787574550.779369:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca401a1b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787574550.779436:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca401a1f000 for lustre-OST0000 00000001:00100000:0.0:1787574550.779697:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787574550.779702:0:9505:0:(genops.c:885:class_export_put()) final put ffff9ca4033be800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787574550.780555:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033be800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787574550.780594:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4033ba800 for lustre-OST0001 00010000:00010000:1.0:1787574551.217904:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574552.241545:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574553.267939:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574553.268261:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574553.268270:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574553.268273:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574553.268277:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574553.268414:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346851072:0@lo:400:kworker.0 00000400:00000100:1.0:1787574553.268484:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346851072 offset 0 length 224: 4 00000100:00100000:2.0:1787574554.225432:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574544/real 1787574544] req@ffff9ca4040a7800 x1874407346850176/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787574554 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574554.225480:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca4040a7800 x1874407346850176/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787574554 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787574554.225506:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca518092800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574554.225541:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787574554.225546:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3633:1874407346850176:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1787574554.225701:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574554.225707:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787574554.225710:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca518092800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574554.225716:0:8:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 483 00000100:00080000:3.0:1787574554.225722:0:8:0:(import.c:589:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787574554.225730:0:8:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9ca518092800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574554.225781:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5f100 x1874407346851200/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574554.225923:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3633:1874407346851200:0@lo:250:kworker.0 00000400:00000100:2.0:1787574554.225995:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874407346851200 offset 0 length 520: 4 00000100:00080000:3.0:1787574554.226126:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574554.226132:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787574554.226280:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346851328:0@lo:400:kworker.0 00000400:00000100:0.0:1787574554.226313:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346851328 offset 0 length 224: 4 00010000:00010000:3.0:1787574554.289724:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574555.313947:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574556.337440:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574557.363663:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574558.385802:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574559.348281:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574549/real 1787574549] req@ffff9ca40423b100 x1874407346850816/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574559 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574559.348315:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca40423b100 x1874407346850816/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574559 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787574559.348334:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca401a1b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787574559.348343:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1874407346850816:0@lo:39:umount.0 00000100:00080000:0.0:1787574559.348487:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787574559.348492:0:15555:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787574559.348497:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787574559.349539:0:15555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574559.349554:0:15555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574559.349579:0:15555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574559.349587:0:15555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574559.349618:0:15555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574559.349626:0:15555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574559.349632:0:15555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574559.349637:0:15555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574559.349642:0:15555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574559.349663:0:15555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787574559.349668:0:15555:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787574559.349691:0:15555:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787574559.349695:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787574559.349699:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574559.349704:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787574559.349708:0:15555:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9ca5350819b8) has no exports 00000020:00080000:0.0:1787574559.349728:0:15555:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9ca5350819b8) has no exports 00010000:00010000:2.0:1787574559.355088:0:13731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574559.355102:0:13731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574559.355114:0:13731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be99400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574559.355120:0:13731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574559.355131:0:13731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574559.355138:0:13731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574559.355144:0:13731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787574559.355146:0:13731:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787574559.355149:0:13731:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787574559.355168:0:13731:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca518092800 00010000:00010000:2.0:1787574559.355172:0:13731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574559.355178:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be99400/0xd18a1efeeddb7f0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb7f13 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574559.355191:0:13731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574559.355195:0:13731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574559.355220:0:13731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74e00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574559.355223:0:13731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574559.355229:0:13731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574559.355235:0:13731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574559.355304:0:13731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787574559.355307:0:13731:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787574559.355309:0:13731:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787574559.355316:0:13731:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca518092800 00010000:00010000:2.0:1787574559.355319:0:13731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574559.355326:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb8190 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb8197 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574559.355334:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574559.355336:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574559.355338:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574559.355540:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787574559.362307:0:15555:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca5202ae0c0 - data ffff9ca527741870/ffff9ca4035f0400 00000020:01000000:0.0:1787574559.362433:0:15555:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca4022a64e0 - data ffff9ca52768aaf8/ffff9ca5054a5c00 00100000:10000000:0.0:1787574559.385560:0:15555:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787574559.392270:0:15555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7c5e 00000020:00000080:1.0:1787574559.392282:0:15555:0:(genops.c:885:class_export_put()) final put ffff9ca401a1c800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787574559.392441:0:15555:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53bc3a000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787574559.392445:0:15555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53bc3a000 2 00000020:01000004:1.0:1787574559.392457:0:15555:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ca53bc3a000 from lustre-OST0000 00000020:00000080:1.0:1787574559.392478:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574559.392485:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787574559.392489:0:15555:0:(genops.c:885:class_export_put()) final put ffff9ca401a1a000/lustre-OST0000_UUID 00000020:00000080:1.0:1787574559.392492:0:15555:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca401a1a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787574559.392499:0:15555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787574559.392556:0:15555:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787574559.392561:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787574559.392564:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574559.392568:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787574559.392575:0:15555:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ca401a1e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787574559.392580:0:15555:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9ca53b14cd28) has exports, disconnecting them 00000020:00080000:1.0:1787574559.392585:0:15555:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ca401a1e000), last request at 1787574276 00000020:00000080:1.0:1787574559.392589:0:15555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7c88 00000020:00080000:1.0:1787574559.392597:0:15555:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca401a1e000): rc 0 00000020:00000080:1.0:1787574559.392601:0:15555:0:(genops.c:885:class_export_put()) final put ffff9ca401a1e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787574559.392630:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca401a1c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787574559.393325:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca401a1e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787574559.414579:0:15555:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787574559.414587:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574559.414592:0:15555:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787574559.414599:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787574559.414777:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574559.414785:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787574559.414792:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787574559.414797:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574559.414800:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787574559.414807:0:15555:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9ca401a19000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787574559.414814:0:15555:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9ca4022219b8) has exports, disconnecting them 00000020:00080000:1.0:1787574559.414818:0:15555:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9ca401a19000), last request at 1787574276 00000020:00000080:1.0:1787574559.414822:0:15555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7c9d 00000020:00080000:1.0:1787574559.414847:0:15555:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca401a19000): rc 0 00000020:00000080:1.0:1787574559.414852:0:15555:0:(genops.c:885:class_export_put()) final put ffff9ca401a19000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787574559.415031:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca401a1d000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787574559.415038:0:8:0:(genops.c:885:class_export_put()) final put ffff9ca535277000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787574559.415040:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca535277000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787574559.415050:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787574559.415127:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca401a19000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787574559.429698:0:15555:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787574559.429706:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787574559.429710:0:15555:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787574559.429717:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787574559.429923:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574559.429932:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787574559.430437:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca401a1b000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787574559.430446:0:8:0:(genops.c:885:class_export_put()) final put ffff9ca401a1a800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787574559.430451:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca401a1a800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787574559.430461:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787574559.430643:0:15555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53bc3a000 1 00000020:00000080:0.0:1787574559.430650:0:15555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7c26 00000020:00000080:0.0:1787574559.430656:0:15555:0:(genops.c:885:class_export_put()) final put ffff9ca52f20b000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787574559.430665:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00010000:00010000:3.0:1787574559.430844:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787574559.430885:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca52f20b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787574559.430907:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574559.430913:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787574559.430917:0:15555:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9ca53b148000) has no exports 00000020:00000080:3.0:1787574559.458752:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574559.458767:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787574559.458772:0:15555:0:(genops.c:885:class_export_put()) final put ffff9ca53bc38800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787574559.458776:0:15555:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53bc38800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787574559.458787:0:15555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787574559.458900:0:15555:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ca53bc3b000 00000020:02000400:3.0:1787574559.458946:0:15555:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:0.0:1787574559.477596:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787574559.477606:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574559.477609:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787574559.477612:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787574559.477669:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574559.477683:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346851456:0@lo:400:kworker.0 00000400:00000100:0.0:1787574559.477740:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346851456 offset 0 length 224: 4 00010000:00010000:3.0:1787574560.433597:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574561.458398:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574562.481426:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787574563.310038:0:15757:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787574563.325055:0:15757:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787574563.325141:0:15757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574563.325156:0:15757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574563.325164:0:15757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574563.325171:0:15757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574563.325199:0:15757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787574563.325204:0:15757:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787574563.325225:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574563.325235:0:15757:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53be5df80 x1874407346850560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787574568 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787574563.325265:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787574563.325272:0:15757:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1787574563.325272:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787574563.325277:0:15757:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1787574563.325279:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca535c11000 already unused, calling callback (ffffffffc12c7c20) 00000100:00080000:1.0:1787574563.325282:0:15757:0:(import.c:65:import_set_state_nolock()) ffff9ca53b11f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:00010000:0.0:1787574563.325283:0:6497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787574563.325286:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574563.325290:0:15757:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53be5df80 x1874407346850560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787574568 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787574563.325291:0:6497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574563.325296:0:15757:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787574563.325299:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 10000000:00010000:0.0:1787574563.325310:0:6497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574563.325316:0:6497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787574563.325319:0:6497:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787574563.325321:0:6497:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787574563.325334:0:6497:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca518092800 00010000:00010000:0.0:1787574563.325337:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574563.325344:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c11000/0xd18a1efeeddb7ee2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb7ee9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574563.325354:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574563.325356:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574563.325358:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574563.325446:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346850560:0@lo:38:kworker.0 00000100:00080000:1.0:1787574563.326366:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787574563.326374:0:15757:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53be5f480 x1874407346850688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574564 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574563.326394:0:15757:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca40423aa00 x1874407346850944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574563.326482:0:15757:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53be5ea00 x1874407346851072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574569 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574563.326501:0:15757:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53be5d500 x1874407346851328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574570 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574563.326510:0:15757:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca404238380 x1874407346851456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574575 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574563.326516:0:15757:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787574563.326521:0:15757:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787574563.326542:0:15757:0:(import.c:65:import_set_state_nolock()) ffff9ca52f20b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787574563.326557:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346851456:0@lo:400:kworker.0 00000100:00100000:0.0:1787574563.326566:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346851328:0@lo:400:kworker.0 00000100:00100000:0.0:1787574563.326573:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346850688:0@lo:400:kworker.0 00000100:00100000:3.0:1787574563.326607:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1874407346851584:0@lo:39:umount.0 00000400:00000100:3.0:1787574563.326653:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346851584 offset 0 length 224: 4 00000100:00100000:2.0:1787574563.326771:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346851072:0@lo:400:kworker.0 00000100:00100000:2.0:1787574563.326778:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346850944:0@lo:400:kworker.0 00010000:00010000:3.0:1787574563.505479:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574564.530573:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787574564.593365:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787574564.593377:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787574565.558857:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574566.577409:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574567.601703:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574568.625594:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574569.457378:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574554/real 1787574554] req@ffff9ca53be5f100 x1874407346851200/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787574569 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574569.457534:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca53be5f100 x1874407346851200/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787574569 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787574569.457554:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca518092800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574569.457579:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787574569.457584:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3633:1874407346851200:0@lo:250:kworker.0 00000100:00080000:2.0:1787574569.458618:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787574569.458625:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787574569.458628:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca518092800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574569.458633:0:38:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 493 00000100:00080000:2.0:1787574569.458639:0:38:0:(import.c:589:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787574569.458646:0:38:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9ca518092800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574569.458680:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404299c00 x1874407346851712/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574569.458772:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3633:1874407346851712:0@lo:250:kworker.0 00000400:00000100:3.0:1787574569.458831:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874407346851712 offset 0 length 520: 4 00010000:00010000:1.0:1787574569.649963:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574570.675049:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574571.697560:0:13730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574572.722454:0:13731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574573.553425:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574563/real 1787574563] req@ffff9ca4040a4700 x1874407346851584/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574573 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574573.553459:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca4040a4700 x1874407346851584/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574573 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787574573.553478:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca52f20b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787574573.553497:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1874407346851584:0@lo:39:umount.0 00000100:00080000:1.0:1787574573.553654:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787574573.553660:0:15757:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787574573.553666:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787574573.554960:0:15757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574573.555085:0:15757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574573.555093:0:15757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574573.555100:0:15757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574573.555152:0:15757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574573.555161:0:15757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574573.555167:0:15757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574573.555174:0:15757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574573.555180:0:15757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574573.555320:0:15757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787574573.555326:0:15757:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787574573.555363:0:15757:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787574573.555367:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787574573.555372:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574573.555378:0:15757:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787574573.555382:0:15757:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9ca52f334d28) has no exports 00000020:00080000:1.0:1787574573.555413:0:15757:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9ca52f334d28) has no exports 00000020:01000000:1.0:1787574573.560552:0:15757:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca4022a6c60 - data ffff9ca52766fca8/ffff9ca4020c3400 00000020:01000000:1.0:1787574573.561109:0:15757:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca4022a6660 - data ffff9ca52766ea20/ffff9ca4033e3c00 00010000:00010000:3.0:1787574573.565785:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574573.565820:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574573.565831:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be98600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574573.565836:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574573.565846:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574573.565854:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574573.565872:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787574573.565875:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787574573.565878:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787574573.565897:0:6498:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca518092800 00010000:00010000:3.0:1787574573.565900:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574573.565907:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be98600/0xd18a1efeeddb7ef0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb7ef7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574573.565920:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574573.565925:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574573.565930:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83e00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574573.565933:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574573.565950:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574573.565967:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574573.565973:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787574573.565975:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787574573.565977:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787574573.565983:0:6498:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca518092800 00010000:00010000:3.0:1787574573.565986:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574573.565991:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb8182 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb8189 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574573.566003:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574573.566005:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574573.566007:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574573.566659:0:6497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787574573.581137:0:15757:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787574573.594751:0:15757:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7d84 00000020:00000080:0.0:1787574573.594763:0:15757:0:(genops.c:885:class_export_put()) final put ffff9ca402711800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787574573.594825:0:15757:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53bf11000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787574573.594830:0:15757:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53bf11000 2 00000020:01000004:0.0:1787574573.594832:0:15757:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ca53bf11000 from lustre-OST0001 00000020:00000080:0.0:1787574573.594855:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574573.594873:0:15757:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787574573.594876:0:15757:0:(genops.c:885:class_export_put()) final put ffff9ca53bc3b800/lustre-OST0001_UUID 00000020:00000080:0.0:1787574573.594879:0:15757:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53bc3b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787574573.594887:0:15757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787574573.594979:0:15757:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1->MGS 00010000:00010000:0.0:1787574573.594995:0:15757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca54216ce00/0xd18a1efeeddb7add lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7ae4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574573.595007:0:15757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca54216ce00/0xd18a1efeeddb7add lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7ae4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574573.595013:0:15757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787574573.595016:0:15757:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787574573.595019:0:15757:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787574573.595032:0:15757:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca518092800 00010000:00010000:0.0:1787574573.595035:0:15757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca54216ce00/0xd18a1efeeddb7add lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb7ae4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574573.595049:0:15757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb7f59 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574573.595056:0:15757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb7f59 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574573.595062:0:15757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787574573.595064:0:15757:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787574573.595065:0:15757:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787574573.595072:0:15757:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca518092800 00010000:00010000:0.0:1787574573.595079:0:15757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca535c11c00/0xd18a1efeeddb7f52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb7f59 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787574573.595094:0:15757:0:(import.c:65:import_set_state_nolock()) ffff9ca518092800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787574573.595098:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787574573.595101:0:15757:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787574573.595102:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787574573.595106:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787574573.595116:0:15757:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca404299c00 x1874407346851712/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787574589 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787574573.595137:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787574573.595140:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1787574573.596802:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1:3633:1874407346851712:0@lo:250:kworker.0 10000000:01000000:0.0:1787574573.596873:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787574573.596884:0:15757:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb79da 00000020:00000080:0.0:1787574573.596891:0:15757:0:(genops.c:885:class_export_put()) final put ffff9ca518096800/61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1 00000020:00000080:1.0:1787574573.598961:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca402711800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787574573.599429:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.140@tcp (flags='') 00000020:00000080:0.0:1787574573.599439:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574573.599447:0:15757:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.140@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787574573.599452:0:15757:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9ca5050d4d28) has no exports 10000000:01000000:3.0:1787574573.600568:0:6506:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787574573.600957:0:15757:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.140@tcp: client import never connected 00000100:00080000:0.0:1787574573.600961:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787574573.600965:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787574573.600969:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787574573.600971:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787574573.603455:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca518096800/61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1 for MGC192.168.202.140@tcp 00000020:00000080:0.0:1787574573.604121:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574573.604132:0:15757:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.140@tcp (uuid 61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1) 00000020:01000000:0.0:1787574573.604141:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787574573.604147:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574573.604153:0:15757:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787574573.604161:0:15757:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ca50501d000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787574573.604167:0:15757:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9ca52f3319b8) has exports, disconnecting them 00000020:00080000:0.0:1787574573.604172:0:15757:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ca50501d000), last request at 1787574305 00000020:00000080:0.0:1787574573.604192:0:15757:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7dae 00000020:00080000:0.0:1787574573.604207:0:15757:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca50501d000): rc 0 00000020:00000080:0.0:1787574573.604212:0:15757:0:(genops.c:885:class_export_put()) final put ffff9ca50501d000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787574573.607402:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca518092800 for MGC192.168.202.140@tcp 00000020:00000080:1.0:1787574573.607421:0:8:0:(genops.c:885:class_export_put()) final put ffff9ca518094000/61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1 00000020:00000080:1.0:1787574573.607439:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca518094000/61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1 for MGC192.168.202.140@tcp 00000020:01000000:1.0:1787574573.607448:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.140@tcp (61e1d82b-ee2d-4c61-a6d3-c059b45cd6a1) 00000020:00000080:1.0:1787574573.612976:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50501d000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787574573.613030:0:15757:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787574573.613035:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574573.613039:0:15757:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787574573.613044:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787574573.613401:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574573.613409:0:15757:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1787574573.613416:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787574573.613420:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574573.613424:0:15757:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787574573.613431:0:15757:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9ca50501b800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787574573.613436:0:15757:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9ca4032c8000) has exports, disconnecting them 00000020:00080000:1.0:1787574573.613441:0:15757:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9ca50501b800), last request at 1787574305 00000020:00000080:1.0:1787574573.613445:0:15757:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7dc3 00000020:00080000:1.0:1787574573.613459:0:15757:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca50501b800): rc 0 00000020:00000080:1.0:1787574573.613464:0:15757:0:(genops.c:885:class_export_put()) final put ffff9ca50501b800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787574573.616436:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca53b11f800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787574573.616455:0:8:0:(genops.c:885:class_export_put()) final put ffff9ca402714000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787574573.616458:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca402714000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787574573.616471:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787574573.621450:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50501b800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1787574573.707001:0:15757:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787574573.707009:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787574573.707013:0:15757:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787574573.707020:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787574573.708843:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca52f20b800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787574573.709670:0:13730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787574573.709777:0:13731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787574573.710183:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1787574573.710433:0:6497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1787574573.710720:0:6492:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ca511559800:6492] 0 exiting: rc = 1 00000100:00100000:3.0:1787574573.710968:0:6493:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ca505078600:6493] 1 exiting: rc = 0 00000100:00100000:0.0:1787574573.711049:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.716774:0:7451:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ca5072f2600:7451] 3 exiting: rc = 0 00000100:00100000:1.0:1787574573.716908:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ca509ad8a00:6496] 2 exiting: rc = 0 00000100:00100000:3.0:1787574573.718513:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ca505079a00:6495] 1 exiting: rc = 0 00000100:00100000:0.0:1787574573.720022:0:6494:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ca5109b2c00:6494] 0 exiting: rc = 1 00000100:00100000:1.0:1787574573.721985:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.721995:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722003:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722008:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722014:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722021:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722027:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722032:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722050:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722056:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722063:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722070:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722076:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722083:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722089:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722095:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722101:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722107:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722112:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722119:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722125:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722129:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722135:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722140:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722145:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722150:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722156:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722161:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722166:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722171:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722176:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722181:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722186:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722191:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722197:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722202:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722207:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722212:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722217:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722223:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722228:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.722233:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723005:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723024:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723029:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723035:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723041:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723048:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723053:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723058:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723064:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723068:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723073:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723079:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723083:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723089:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723094:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723099:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723105:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723110:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723115:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723121:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723126:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.723132:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787574573.729594:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574573.729608:0:15757:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1787574573.729615:0:15757:0:(genops.c:885:class_export_put()) final put ffff9ca50501c800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1787574573.729619:0:15757:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50501c800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1787574573.729629:0:15757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1787574573.729692:0:15757:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53bf11000 1 00000020:00000080:2.0:1787574573.729698:0:15757:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb7d53 00000020:00000080:2.0:1787574573.729704:0:15757:0:(genops.c:885:class_export_put()) final put ffff9ca53bf13800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787574573.729756:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787574573.729760:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574573.729775:0:15757:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787574573.729779:0:15757:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9ca4024cb370) has no exports 00000020:00000080:3.0:1787574573.732694:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53bf13800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787574573.777103:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574573.777116:0:15757:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787574573.777122:0:15757:0:(genops.c:885:class_export_put()) final put ffff9ca53bf10800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787574573.777127:0:15757:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53bf10800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787574573.777133:0:15757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787574573.777738:0:15757:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ca53bf14800 00000020:01000000:2.0:1787574573.777764:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787574573.777769:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574573.777772:0:15757:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787574573.777776:0:15757:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9ca535084d28) has no exports 00000020:00000080:2.0:1787574573.777800:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574573.777805:0:15757:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787574573.777808:0:15757:0:(genops.c:885:class_export_put()) final put ffff9ca52f209000/OSS_uuid 00000020:00000080:2.0:1787574573.777810:0:15757:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca52f209000/OSS_uuid for OSS 00000020:01000000:2.0:1787574573.777814:0:15757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787574573.777985:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ca520268400:8426] 2 exiting: rc = 0 00000100:00100000:0.0:1787574573.778068:0:8425:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ca520269200:8425] 1 exiting: rc = 0 00000100:00100000:3.0:1787574573.778179:0:8619:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ca53bfab400:8619] 3 exiting: rc = 0 00000100:00100000:3.0:1787574573.778263:0:8423:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ca52055bc00:8423] 0 exiting: rc = 1 00000100:00100000:0.0:1787574573.781750:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781765:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781772:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781782:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781788:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781793:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781799:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781804:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781810:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781814:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781820:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781825:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781830:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781835:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781844:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781850:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781855:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781873:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781879:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781884:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781901:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781906:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781912:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781917:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781921:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781926:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781932:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781937:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781942:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781946:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781952:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781957:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781962:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781967:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781972:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781977:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781982:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781987:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781991:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.781996:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782001:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782006:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782012:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782017:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782022:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782027:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782032:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782037:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782043:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782047:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782052:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782057:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782062:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782067:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782072:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782081:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782086:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782090:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782096:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782102:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782107:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782112:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782118:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574573.782127:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:1.0:1787574573.783159:0:6505:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787574573.783707:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ca520268000:8427] 0 exiting: rc = 1 00000100:00100000:3.0:1787574573.783769:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ca53528ba00:8428] 1 exiting: rc = 0 00000100:00100000:2.0:1787574573.784438:0:10243:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9ca535340200:10243] 2 exiting: rc = 0 00000100:00100000:1.0:1787574573.784663:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784677:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784684:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784689:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784695:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784701:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784707:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784712:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784717:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784722:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784727:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784732:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784737:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784752:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784757:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784762:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784768:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784773:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784778:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784783:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784788:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784793:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784799:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784804:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784810:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784814:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784819:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784825:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784830:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784836:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784840:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784845:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784851:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784855:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784871:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784876:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784882:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784887:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784893:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784898:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784903:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784909:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784913:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784919:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784925:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784931:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784937:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784943:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784957:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784963:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784968:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784973:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784979:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784984:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784988:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784994:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.784999:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.785004:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.785009:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.785014:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.785019:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.785023:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.785028:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.785036:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574573.789119:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ca53bc2d400:8431] 2 exiting: rc = 0 00000100:00100000:0.0:1787574573.790131:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ca53bc2cc00:8429] 0 exiting: rc = 1 00000100:00100000:2.0:1787574573.791790:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ca53bc2c200:8430] 1 exiting: rc = 0 00000100:00100000:1.0:1787574573.792429:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792438:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792445:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792451:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792457:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792462:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792469:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792484:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792491:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792497:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792503:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792508:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792514:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792519:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792525:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792543:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792550:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792556:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792561:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792579:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792584:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792590:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792596:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792601:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792606:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792612:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792617:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792622:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792628:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792633:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792638:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792644:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792650:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792655:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792661:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792667:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792672:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792677:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792684:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792701:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792708:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792713:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792719:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792724:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792729:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792735:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792741:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792746:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792752:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792758:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792764:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792777:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792784:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792789:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792799:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792811:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792823:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792829:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792835:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792840:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792846:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792851:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792856:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.792873:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.810384:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ca50509fe00:8433] 1 exiting: rc = 0 00000100:00100000:1.0:1787574573.811033:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ca5352aec00:8432] 0 exiting: rc = 1 00000100:00100000:2.0:1787574573.811138:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811145:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811151:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811156:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811161:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811167:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811171:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811177:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811182:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811187:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811192:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811197:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811203:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811221:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811226:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811231:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811267:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811276:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811281:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811285:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811291:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811296:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811301:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811407:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811413:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811418:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811424:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811430:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811435:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811439:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811445:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811450:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811456:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811461:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811467:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811537:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811544:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811550:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811555:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811561:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811567:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811573:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811578:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811583:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811588:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811594:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811599:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811605:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811617:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811622:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811626:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811631:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811636:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811642:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811647:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811652:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811657:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811662:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811668:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811673:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811679:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811684:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811689:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.811699:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574573.815556:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ca50507a400:8434] 0 exiting: rc = 1 00000100:00100000:1.0:1787574573.815649:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ca518694e00:8435] 1 exiting: rc = 0 00000100:00100000:2.0:1787574573.819738:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819749:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819755:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819761:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819767:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819793:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819800:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819806:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819811:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819818:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819826:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819834:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819840:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819847:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819852:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819859:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819865:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819885:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819894:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819913:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819919:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819925:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819931:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819937:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819943:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819949:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819955:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819960:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819967:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819984:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819991:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.819996:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820003:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820009:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820015:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820020:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820027:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820032:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820038:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820045:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820050:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820068:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820074:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820080:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820086:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820092:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820098:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820104:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820110:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820116:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820121:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820128:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820134:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820152:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820162:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820167:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820173:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820179:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820186:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820192:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820198:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820204:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820210:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574573.820222:0:15757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787574573.842012:0:15757:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787574594.145824:0:16521:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787574606.092950:0:17122:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787574606.092957:0:17122:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787574606.092959:0:17122:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787574606.093351:0:17122:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ca53f52b800 00000020:01000004:2.0:1787574606.093368:0:17122:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787574606.093375:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787574606.093389:0:17122:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ca4022219b8) 00000020:00000080:2.0:1787574606.093402:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787574606.136885:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787574606.138096:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787574606.139439:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787574606.139604:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787574606.139884:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787574606.140111:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787574606.140320:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787574606.140451:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787574606.140581:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787574606.140761:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787574606.141136:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787574606.141456:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787574606.141636:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.141887:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.142117:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.142275:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787574606.142424:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787574606.142662:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787574606.142970:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.143226:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.143678:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787574606.144031:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.144279:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.144526:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.144717:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.145080:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.145350:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787574606.145563:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.146320:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787574606.146490:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.146628:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787574606.146864:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787574606.147115:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787574606.147309:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787574606.148362:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.155315:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.155480:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787574606.155724:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787574606.155960:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.156230:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787574606.156524:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787574606.156712:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.156966:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.157343:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787574606.157496:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787574606.157672:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.157896:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.158374:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.158667:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.158891:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.159317:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.159449:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787574606.159667:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1787574606.160529:0:17122:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787574606.160730:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787574606.160737:0:17122:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787574606.160748:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb8f97 00000020:01000004:3.0:1787574606.160755:0:17122:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787574606.160760:0:17122:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787574606.160765:0:17122:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca53f52b800 from MGS 00000020:01000004:3.0:1787574606.160878:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787574606.160891:0:17122:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ca4024ccd28) 00000020:00000080:3.0:1787574606.160902:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787574606.160969:0:17122:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53f52b800 from MGS, refs=2 00080000:01000000:3.0:1787574606.160973:0:17122:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787574606.160978:0:17122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb8fa5 00000100:00100000:3.0:1787574606.161089:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787574606.161226:0:17122:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787574606.161232:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787574606.161892:0:17122:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787574606.161900:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787574606.162537:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574606.162683:0:17122:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787574606.162688:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787574606.163419:0:17122:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787574606.163424:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787574606.163688:0:17122:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787574606.163692:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787574606.164325:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574606.164328:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574606.164330:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574606.164477:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574606.164480:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574606.164490:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574606.165199:0:17122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787574606.167170:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787574606.169753:0:17122:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787574606.170758:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787574606.170813:0:17122:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787574606.170849:0:17122:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787574606.171470:0:17122:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787574606.171770:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574606.171935:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787574606.171941:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787574606.172617:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787574606.172624:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787574606.172903:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787574606.172909:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787574606.173838:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787574606.173860:0:17122:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.140@tcp' 00000020:01000004:3.0:1787574606.173862:0:17122:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787574606.173889:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.140@tcp (typ=mgc) 00000020:00000080:3.0:1787574606.173901:0:17122:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.140@tcp (ffff9ca4024c99b8) 00000020:00000080:3.0:1787574606.173916:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787574606.173990:0:17122:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca50500b800@MGC192.168.202.140@tcp: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1787574606.174284:0:17122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.140@tcp-0 is initialized 00000040:01000000:3.0:1787574606.174290:0:17122:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787574606.174619:0:17138:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787574606.174700:0:17139:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787574606.174782:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.140@tcp (uuid c736e7c1-73c2-4d34-bc3f-9b57260ebf6b) 00000020:00000080:1.0:1787574606.174797:0:17122:0:(genops.c:1385:class_connect()) connect: client c736e7c1-73c2-4d34-bc3f-9b57260ebf6b, cookie 0xd18a1efeeddb8fb3 00000100:00080000:1.0:1787574606.174807:0:17122:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574606.174813:0:17122:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9ca50500b800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574606.174850:0:17122:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca4040a4a80 x1874407346851840/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574606.174907:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3633:1874407346851840:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787574606.174968:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574606.175066:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346851840 00000100:00100000:0.0:1787574606.175073:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346851840 00000100:00100000:0.0:1787574606.175115:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574606.175123:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3633:x1874407346851840:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787574606.175143:0:17135:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c736e7c1-73c2-4d34-bc3f-9b57260ebf6b@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1787574606.175163:0:17135:0:(genops.c:1385:class_connect()) connect: client c736e7c1-73c2-4d34-bc3f-9b57260ebf6b, cookie 0xd18a1efeeddb8fba 00000100:00080000:0.0:1787574606.175288:0:17135:0:(import.c:65:import_set_state_nolock()) ffff9ca5204af000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787574606.175483:0:17122:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS 00000020:01000004:1.0:1787574606.175503:0:17122:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787574606.175507:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787574606.175518:0:17122:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ca4032c99b8) 00000020:00000080:1.0:1787574606.175527:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787574606.178194:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+5:3633:x1874407346851840:12345-0@lo:250:mount.lustre.0 Request processed in 3061us (3215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574606.178209:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574606.178455:0:3633:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787574606.178467:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.140@tcp: connect to target with instance 0 00000100:00080000:3.0:1787574606.178475:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787574606.178479:0:3633:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787574606.178484:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca50500b800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787574606.178487:0:3633:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787574606.178505:0:3633:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787574606.178512:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3633:1874407346851840:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787574606.185544:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574606.186411:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787574606.186418:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787574606.194028:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787574606.194177:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787574606.204983:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787574606.204999:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787574606.206712:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787574606.207093:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787574606.207107:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787574606.208259:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787574606.208268:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787574606.260205:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574606.260524:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787574606.260531:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787574606.263162:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787574606.263174:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787574606.264223:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574606.264458:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787574606.264463:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787574606.265130:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787574606.265137:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787574606.265968:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574606.266280:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787574606.266285:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787574606.266992:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787574606.266999:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787574606.268389:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574606.268552:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787574606.268558:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787574606.269333:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787574606.269341:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787574606.288614:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574606.289123:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787574606.289132:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787574606.291032:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787574606.291042:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787574606.292382:0:17122:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787574606.292394:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787574606.293623:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787574606.293652:0:17122:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787574606.293659:0:17122:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787574606.293898:0:17122:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787574606.293932:0:17122:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787574606.293936:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787574606.293938:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574606.293939:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574606.293940:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574606.293942:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574606.293943:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574606.293944:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574606.293946:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574606.293948:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574606.293949:0:17122:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574606.293952:0:17122:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787574606.293954:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574606.293955:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574606.293956:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574606.293957:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574606.293958:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574606.293959:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574606.293960:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574606.293961:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574606.293962:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574606.293963:0:17122:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574606.293990:0:17122:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787574606.294009:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346851968:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787574606.294158:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.294601:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50664b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787574606.294659:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346851968 00000100:00100000:0.0:1787574606.294667:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346851968 00000100:00100000:0.0:1787574606.294713:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574606.294723:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+5:17122:x1874407346851968:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787574606.294786:0:17137:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787574606.294790:0:17137:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787574606.294792:0:17137:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787574606.295158:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787574606.295700:0:17137:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1787574606.297729:0:17160:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787574606.297736:0:17160:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787574606.297739:0:17160:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787574606.297877:0:17160:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787574606.298068:0:17160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787574606.298571:0:17137:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787574606.298582:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787574606.300923:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+5:17122:x1874407346851968:12345-0@lo:253:mount.lustre.0 Request processed in 6192us (6757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574606.300937:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787574606.301076:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346851968:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574606.301111:0:17122:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787574606.301115:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574606.301116:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574606.301117:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574606.301118:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574606.301119:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574606.301120:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574606.301122:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574606.301123:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574606.301126:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574606.301127:0:17122:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787574606.301147:0:17122:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca53f52b800 from lustre-MDT0000 10000000:01000000:2.0:1787574606.301179:0:17122:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787574606.301182:0:17122:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787574606.301187:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ca4024c99b8 10000000:01000000:2.0:1787574606.301191:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787574606.301198:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ca4024c99b8 from 1 10000000:01000000:2.0:1787574606.301202:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787574606.301425:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.301438:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.301448:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574606.301469:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574606.301506:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.301545:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50664be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574606.301603:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346852096 00000100:00100000:3.0:1787574606.301610:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346852096 00000100:00100000:3.0:1787574606.301650:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574606.301660:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+5:17122:x1874407346852096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574606.301671:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574606.301686:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb8fcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb8fc8 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.301709:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb8fcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb8fc8 expref: 6 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.301720:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb8fcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb8fc8 expref: 6 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.301730:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb600, rc 0) 00000100:00100000:2.0:1787574606.302091:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852096:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574606.302115:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.302133:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574606.302427:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+6:17122:x1874407346852096:12345-0@lo:101:mount.lustre.0 Request processed in 766us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574606.302565:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574606.302650:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574606.302682:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.302758:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50664be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574606.302925:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346852224 00000100:00100000:0.0:1787574606.302931:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346852224 00000100:00100000:0.0:1787574606.303024:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574606.303033:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+6:17122:x1874407346852224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574606.303125:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+6:17122:x1874407346852224:12345-0@lo:501:mount.lustre.0 Request processed in 93us (441us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787574606.303132:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574606.303196:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852224:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787574606.303226:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787574606.303281:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.303290:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574606.303299:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca53f52b800 10000000:01000000:2.0:1787574606.303303:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787574606.303307:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ca53f52b800 10000000:01000000:2.0:1787574606.303310:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787574606.303314:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ca53f52b800 from 1 10000000:01000000:2.0:1787574606.303316:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787574606.303337:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.303345:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.303353:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574606.303375:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574606.303402:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.304035:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50664be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574606.304153:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346852352 00000100:00100000:1.0:1787574606.304159:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346852352 00000100:00100000:1.0:1787574606.304188:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574606.304195:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+6:17122:x1874407346852352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574606.304204:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574606.304219:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca509e18e00/0xd18a1efeeddb8fdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb8fd6 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574606.304266:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca509e18e00/0xd18a1efeeddb8fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb8fd6 expref: 7 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574606.304277:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca509e18e00/0xd18a1efeeddb8fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb8fd6 expref: 7 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574606.304286:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e18e00, rc 0) 00000100:00100000:1.0:1787574606.304322:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+7:17122:x1874407346852352:12345-0@lo:101:mount.lustre.0 Request processed in 128us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574606.304328:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574606.304423:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574606.304435:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.304443:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574606.304457:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787574606.304474:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.304481:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574606.304488:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787574606.304492:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787574606.304497:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ca53f52b800 10000000:01000000:2.0:1787574606.304500:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787574606.304503:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787574606.304505:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787574606.304522:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.304529:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.304543:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574606.304558:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574606.304586:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.304604:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50664be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574606.304661:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346852480 00000100:00100000:1.0:1787574606.304665:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346852480 00000100:00100000:1.0:1787574606.304683:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574606.304688:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+7:17122:x1874407346852480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574606.304694:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574606.304702:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca509e18400/0xd18a1efeeddb8feb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb8fe4 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574606.304714:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca509e18400/0xd18a1efeeddb8feb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb8fe4 expref: 8 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574606.304722:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca509e18400/0xd18a1efeeddb8feb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb8fe4 expref: 8 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574606.304728:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e18400, rc 0) 00000100:00100000:2.0:1787574606.304924:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574606.304935:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.304942:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574606.304990:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574606.305028:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.305038:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50664be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574606.305138:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+8:17122:x1874407346852480:12345-0@lo:101:mount.lustre.0 Request processed in 449us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574606.305144:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574606.305164:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346852608 00000100:00100000:1.0:1787574606.305168:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346852608 00000100:00100000:1.0:1787574606.305183:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574606.305189:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+8:17122:x1874407346852608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574606.305353:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+9:17122:x1874407346852608:12345-0@lo:501:mount.lustre.0 Request processed in 164us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574606.305360:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574606.305451:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574606.305480:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574606.305520:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.305545:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50664be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574606.305594:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346852736 00000100:00100000:1.0:1787574606.305598:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346852736 00000100:00100000:1.0:1787574606.305616:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574606.305621:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+9:17122:x1874407346852736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574606.307455:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+9:17122:x1874407346852736:12345-0@lo:503:mount.lustre.0 Request processed in 1824us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574606.307467:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574606.307941:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346852736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574606.308561:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17161:1874407346852864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574606.308612:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574606.308650:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574606.308909:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346852864 00000100:00100000:0.0:1787574606.308916:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346852864 00000100:00100000:0.0:1787574606.308956:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574606.308964:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+9:17161:x1874407346852864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574606.309885:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+9:17161:x1874407346852864:12345-0@lo:502:llog_process_th.0 Request processed in 916us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574606.309896:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574606.310009:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17161:1874407346852864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574606.310053:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574606.310065:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574606.310068:0:17161:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787574606.310072:0:17161:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787574606.310076:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574606.310090:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ca4032cb370) 00000020:00000080:1.0:1787574606.310115:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787574606.310121:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787574606.310199:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787574606.310206:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb8ff9 00000020:00000080:1.0:1787574606.310580:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787574606.310585:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574606.310588:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574606.310590:0:17161:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787574606.310592:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574606.310595:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574606.310597:0:17161:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787574606.310600:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574606.310608:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ca4032c8000) 00000020:00000080:1.0:1787574606.310618:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787574606.310622:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787574606.310624:0:17161:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787574606.310634:0:17161:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787574606.310641:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787574606.310684:0:17161:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53f52b800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787574606.310697:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ca4032ccd28) 00000020:00000080:1.0:1787574606.310705:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787574606.310764:0:17161:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787574606.310880:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb900e 00000020:00000080:1.0:1787574606.310971:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787574606.310977:0:17161:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787574606.310982:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd18a1efeeddb9015 00080000:01000000:1.0:1787574606.310988:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787574606.310991:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb901c 00010000:00010000:1.0:1787574606.398692:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787574606.399225:0:17161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:1.0:1787574606.400128:0:17161:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787574606.400975:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ca53b148000) 00000020:00000080:1.0:1787574606.400995:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787574606.404314:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787574606.404329:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb902a 00000020:00000080:1.0:1787574606.405879:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787574606.409906:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd18a1efeeddb9031 00000020:00000080:3.0:1787574606.410937:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787574606.410950:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574606.410964:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574606.410966:0:17161:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787574606.410970:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787574606.410973:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787574606.410974:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787574606.410976:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787574606.410977:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787574606.410979:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574606.410981:0:17161:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787574606.410983:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574606.410988:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574606.410989:0:17161:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787574606.410994:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787574606.411047:0:17161:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787574606.411067:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574606.411071:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574606.411072:0:17161:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787574606.411075:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574606.411078:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574606.411079:0:17161:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787574606.411082:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787574606.411087:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:3.0:1787574606.411129:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787574606.411143:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9ca4024cb370) 00000020:00000080:3.0:1787574606.411159:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787574606.411164:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787574606.411215:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787574606.411220:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787574606.411226:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb903f 00010000:00080000:3.0:1787574606.411288:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca51ebe7800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1787574606.417842:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1787574606.419053:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787574606.419069:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787574606.419111:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787574606.419132:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb9046 00000100:00080000:1.0:1787574606.419142:0:17161:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574606.419149:0:17161:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ca51ebe7800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574606.419185:0:17161:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca4040a4000 x1874407346852992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574606.419214:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1787574606.419287:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574606.419297:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574606.419299:0:17161:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787574606.419303:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787574606.419306:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1787574606.419307:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574606.419309:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574606.419310:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787574606.419313:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574606.419314:0:17161:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787574606.419316:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787574606.419321:0:17161:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787574606.419323:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574606.419324:0:17161:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787574606.419327:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787574606.419331:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:1.0:1787574606.419356:0:17161:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787574606.419358:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574606.419371:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ca53b14cd28) 00000020:00000080:1.0:1787574606.419382:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787574606.419386:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787574606.419456:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787574606.419462:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787574606.419468:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb9054 00010000:00080000:1.0:1787574606.419622:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca51ebe0800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1787574606.419983:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1787574606.420593:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346852992:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787574606.420670:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574606.420747:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346852992 00000100:00100000:3.0:1787574606.420755:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346852992 00000100:00100000:3.0:1787574606.420794:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574606.420801:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1874407346852992:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787574606.420816:0:17148:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1787574606.427282:0:17161:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787574606.427598:0:17161:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787574606.436013:0:17161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574606.436885:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787574606.444749:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:3.0:1787574606.453812:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1874407346852992:12345-0@lo:38:llog_process_th.0 Request processed in 33000us (33133us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787574606.453826:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787574606.453877:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574606.453883:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787574606.453887:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346852992:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787574606.454701:0:17167:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787574606.454707:0:17167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787574606.455938:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787574606.455956:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787574606.455996:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787574606.456028:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb905b 00000100:00080000:2.0:1787574606.456038:0:17161:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787574606.456044:0:17161:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ca51ebe0800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574606.456075:0:17161:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404298e00 x1874407346853120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574606.456109:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787574606.456206:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574606.456209:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.456211:0:17161:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787574606.456212:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787574606.456215:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787574606.456216:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787574606.456217:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787574606.456218:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787574606.456219:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.456220:0:17161:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787574606.456221:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787574606.456224:0:17161:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787574606.456226:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.456227:0:17161:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787574606.456228:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787574606.456231:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:2.0:1787574606.456265:0:17161:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787574606.456268:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574606.456276:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ca402220000) 00000020:00000080:2.0:1787574606.456284:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787574606.456287:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787574606.456327:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787574606.456331:0:17161:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787574606.456341:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb9069 00010000:00080000:2.0:1787574606.456364:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca4037f4000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1787574606.456534:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787574606.456596:0:17161:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787574606.456611:0:17161:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787574606.457478:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346853120:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787574606.457553:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346853120 offset 0 length 520: 4 00000040:00080000:2.0:1787574606.458963:0:17161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574606.459712:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787574606.459929:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787574606.460832:0:17169:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787574606.460838:0:17169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787574606.461731:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787574606.461744:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787574606.461842:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787574606.461862:0:17161:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb9070 00000100:00080000:2.0:1787574606.461872:0:17161:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787574606.461877:0:17161:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca4037f4000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574606.461911:0:17161:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca40429b100 x1874407346853248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574606.461990:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346853248:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787574606.462053:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346853248 offset 0 length 520: 4 00000100:00080000:2.0:1787574606.462109:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787574606.462165:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574606.462169:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.462171:0:17161:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787574606.462174:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574606.462178:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.462179:0:17161:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787574606.462182:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787574606.462184:0:17161:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787574606.462186:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574606.462188:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.462189:0:17161:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787574606.462191:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574606.462193:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.462194:0:17161:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787574606.462197:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787574606.462235:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17161:1874407346853376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574606.462304:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.462339:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346853376 00000100:00100000:2.0:1787574606.462346:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346853376 00000100:00100000:2.0:1787574606.462385:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574606.462393:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+9:17161:x1874407346853376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574606.462495:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+9:17161:x1874407346853376:12345-0@lo:502:llog_process_th.0 Request processed in 102us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574606.462503:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574606.462548:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574606.462567:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17161:1874407346853376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574606.462590:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574606.462595:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.462596:0:17161:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787574606.462599:0:17161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787574606.462643:0:17122:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787574606.462666:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787574606.462682:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.462693:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574606.462700:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca53f52b800 from 1 10000000:01000000:2.0:1787574606.462704:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787574606.462727:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.462735:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.462750:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574606.462762:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346853504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574606.463093:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.463124:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574606.463285:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346853504 00000100:00100000:0.0:1787574606.463291:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346853504 00000100:00100000:0.0:1787574606.463319:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574606.463335:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+9:17122:x1874407346853504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574606.463346:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574606.463360:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409ca00/0xd18a1efeeddb907e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9077 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.463380:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409ca00/0xd18a1efeeddb907e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9077 expref: 10 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.463392:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409ca00/0xd18a1efeeddb907e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9077 expref: 10 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.463400:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409ca00, rc 0) 00000100:00100000:0.0:1787574606.463432:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+10:17122:x1874407346853504:12345-0@lo:101:mount.lustre.0 Request processed in 99us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574606.463438:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574606.464687:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346853504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574606.464710:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.464721:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574606.465620:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346853632:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787574606.465685:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.465795:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787574606.465960:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346853632 00000100:00100000:1.0:1787574606.465974:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346853632 00000100:00100000:1.0:1787574606.466133:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574606.466143:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+10:17122:x1874407346853632:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787574606.466163:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787574606.466169:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787574606.466277:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+10:17122:x1874407346853632:12345-0@lo:256:mount.lustre.0 Request processed in 135us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574606.466284:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574606.466365:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346853632:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787574606.466952:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574606.466986:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.466996:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574606.467003:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53f52b800 from 1 10000000:01000000:2.0:1787574606.467007:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574606.467301:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.467308:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.467317:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574606.467333:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346853760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574606.467370:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.467667:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574606.467757:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346853760 00000100:00100000:0.0:1787574606.467765:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346853760 00000100:00100000:0.0:1787574606.467806:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787574606.467816:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+10:17122:x1874407346853760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574606.467827:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574606.467840:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb908c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9085 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.467862:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb908c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9085 expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.467873:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb908c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9085 expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.467895:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c600, rc 0) 00000100:00100000:0.0:1787574606.467941:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+11:17122:x1874407346853760:12345-0@lo:101:mount.lustre.0 Request processed in 127us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574606.467949:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574606.468136:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346853760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574606.468149:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.468157:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574606.468214:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346853888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574606.468268:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.468285:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574606.468333:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346853888 00000100:00100000:0.0:1787574606.468338:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346853888 00000100:00100000:0.0:1787574606.468356:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787574606.468362:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+11:17122:x1874407346853888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574606.468554:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+11:17122:x1874407346853888:12345-0@lo:501:mount.lustre.0 Request processed in 190us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574606.468562:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574606.468630:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346853888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574606.468657:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346854016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574606.468694:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.468715:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574606.468761:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346854016 00000100:00100000:0.0:1787574606.468765:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346854016 00000100:00100000:0.0:1787574606.468792:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574606.468797:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+11:17122:x1874407346854016:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574606.468883:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+11:17122:x1874407346854016:12345-0@lo:503:mount.lustre.0 Request processed in 85us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574606.468889:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574606.469021:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346854016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574606.469721:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17171:1874407346854144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574606.469760:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.469798:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574606.469891:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346854144 00000100:00100000:0.0:1787574606.469896:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346854144 00000100:00100000:0.0:1787574606.470029:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787574606.470037:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+11:17171:x1874407346854144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574606.471204:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+11:17171:x1874407346854144:12345-0@lo:502:llog_process_th.0 Request processed in 1165us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574606.471214:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574606.471350:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17171:1874407346854144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787574606.471384:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574606.471393:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.471395:0:17171:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787574606.471402:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca53f52b800 00000020:00000080:2.0:1787574606.471404:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787574606.471413:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574606.471416:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.471417:0:17171:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787574606.471419:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574606.471421:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.471422:0:17171:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787574606.471425:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca53f52b800 00000020:00000080:2.0:1787574606.471428:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787574606.471480:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574606.472987:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.472993:0:17171:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787574606.473000:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574606.473005:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574606.473006:0:17171:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787574606.473010:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca53f52b800 00000020:00000080:2.0:1787574606.473012:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787574606.473054:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574606.478074:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574606.478082:0:17171:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787574606.478094:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574606.478111:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574606.478113:0:17171:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787574606.478118:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca53f52b800 00000020:00000080:0.0:1787574606.478121:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787574606.478215:0:17171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17171:1874407346854272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574606.478324:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574606.478372:0:17171:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507eac600 going to sleep for 11 seconds 00000100:00100000:1.0:1787574606.478619:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346854272 00000100:00100000:1.0:1787574606.478627:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346854272 00000100:00100000:1.0:1787574606.478670:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787574606.478680:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+11:17171:x1874407346854272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574606.479925:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+11:17171:x1874407346854272:12345-0@lo:502:llog_process_th.0 Request processed in 1240us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574606.479937:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787574606.480007:0:17171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17171:1874407346854272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574606.480172:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574606.480179:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574606.480182:0:17171:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787574606.480186:0:17171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787574606.480572:0:17122:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787574606.480598:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574606.480614:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.480625:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574606.480672:0:17122:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787574606.480675:0:17122:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca53f52b800 10000000:01000000:0.0:1787574606.480678:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca53f52b800 10000000:01000000:0.0:1787574606.480682:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787574606.480688:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca53f52b800 from 1 10000000:01000000:0.0:1787574606.480691:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574606.480723:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.480731:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.480740:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574606.480767:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346854400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787574606.480916:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574606.480945:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50664b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787574606.480962:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346854400 00000100:00100000:0.0:1787574606.480968:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346854400 00000100:00100000:0.0:1787574606.481008:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787574606.481728:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+11:17122:x1874407346854400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574606.481742:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574606.481755:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409cc00/0xd18a1efeeddb909a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9093 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.481851:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409cc00/0xd18a1efeeddb909a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9093 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.481865:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409cc00/0xd18a1efeeddb909a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9093 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.481873:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409cc00, rc 0) 00000100:00100000:0.0:1787574606.481925:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17122:x1874407346854400:12345-0@lo:101:mount.lustre.0 Request processed in 202us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574606.485337:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346854400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574606.485364:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.485387:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574606.485921:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346854528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574606.485986:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.486040:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50b71df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574606.486753:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346854528 00000100:00100000:3.0:1787574606.486762:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346854528 00000100:00100000:3.0:1787574606.486873:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574606.486884:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+13:17122:x1874407346854528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574606.487107:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+13:17122:x1874407346854528:12345-0@lo:501:mount.lustre.0 Request processed in 216us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574606.487116:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574606.487432:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346854528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574606.487540:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346854656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574606.487586:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.487617:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50b71df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574606.487707:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346854656 00000100:00100000:3.0:1787574606.487718:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346854656 00000100:00100000:3.0:1787574606.487745:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574606.487752:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+13:17122:x1874407346854656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574606.487906:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+13:17122:x1874407346854656:12345-0@lo:503:mount.lustre.0 Request processed in 154us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574606.487913:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787574606.487918:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346854656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574606.488143:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17175:1874407346854784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574606.488179:0:17175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.488198:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50b71d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574606.488685:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346854784 00000100:00100000:3.0:1787574606.488691:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346854784 00000100:00100000:3.0:1787574606.488723:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787574606.488729:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+13:17175:x1874407346854784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574606.488883:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+13:17175:x1874407346854784:12345-0@lo:502:llog_process_th.0 Request processed in 153us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574606.488891:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787574606.489063:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17175:1874407346854784:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787574606.489126:0:17175:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787574606.489140:0:17175:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ca402224d28) 00000020:00000080:2.0:1787574606.489158:0:17175:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787574606.489251:0:17175:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53f52b800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787574606.489256:0:17175:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53f52b800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787574606.489258:0:17175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53f52b800 4 00010000:00080000:2.0:1787574606.489284:0:17175:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca403184800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1787574606.490862:0:17175:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000100:00100000:0.0:1787574606.492162:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000020:00000080:2.0:1787574606.499021:0:17175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787574606.499158:0:17175:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787574606.499171:0:17175:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd18a1efeeddb90a8 00000100:00080000:2.0:1787574606.499182:0:17175:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787574606.499188:0:17175:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ca403184800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574606.499221:0:17175:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404299f80 x1874407346854912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574606.499262:0:17175:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787574606.502108:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346854912:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787574606.502182:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.502273:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346854912 00000100:00100000:2.0:1787574606.502280:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346854912 00000100:00100000:2.0:1787574606.502320:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574606.502327:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346854912:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787574606.502380:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346854912:12345-0@lo:38:llog_process_th.0 Request processed in 52us (198us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787574606.502387:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574606.502420:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574606.502429:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca403184800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574606.502445:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787574606.502449:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346854912:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787574606.504396:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17175:1874407346855040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574606.504467:0:17175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.504515:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca508f866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574606.506629:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346855040 00000100:00100000:3.0:1787574606.506644:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346855040 00000100:00100000:3.0:1787574606.506718:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574606.506729:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17175:x1874407346855040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574606.506936:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17175:x1874407346855040:12345-0@lo:502:llog_process_th.0 Request processed in 208us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574606.506943:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574606.507085:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17175:1874407346855040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574606.507156:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17175:1874407346855168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574606.507198:0:17175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574606.507221:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346855168 00000100:00100000:3.0:1787574606.507224:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346855168 00000100:00100000:3.0:1787574606.515857:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574606.515885:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17175:x1874407346855168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574606.516051:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17175:x1874407346855168:12345-0@lo:502:llog_process_th.0 Request processed in 170us (8852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574606.516060:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574606.516138:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca521885900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574606.516166:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17175:1874407346855168:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787574606.516204:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787574606.516290:0:17122:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787574606.516311:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574606.516327:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.516343:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787574606.516393:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787574606.516395:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574606.516396:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574606.516398:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574606.516399:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574606.516400:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574606.516402:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574606.516403:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574606.516405:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574606.516406:0:17122:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574606.516409:0:17122:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787574606.516412:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574606.516413:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574606.516415:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574606.516416:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574606.516417:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574606.516418:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574606.516419:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574606.516420:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574606.516421:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574606.516422:0:17122:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574606.516454:0:17122:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787574606.516470:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346855296:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787574606.516507:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.516536:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca508f86f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574606.516655:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346855296 00000100:00100000:3.0:1787574606.516661:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346855296 00000100:00100000:3.0:1787574606.516693:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574606.516700:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17122:x1874407346855296:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787574606.516719:0:17135:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787574606.516732:0:17135:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787574606.523887:0:17135:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787574606.523933:0:17135:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787574606.524283:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17122:x1874407346855296:12345-0@lo:253:mount.lustre.0 Request processed in 7577us (7769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574606.524295:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:2.0:1787574606.524369:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787574606.524375:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787574606.524396:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.524410:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca40409ca00/0xd18a1efeeddb907e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9077 expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.524426:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.524460:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca40409ca00/0xd18a1efeeddb907e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9077 expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.524473:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca40409ca00/0xd18a1efeeddb907e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9077 expref: 11 pid: 17137 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574606.524487:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346855424:0@lo:104: 00000100:00100000:2.0:1787574606.524522:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574606.524601:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca508f86cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574606.524645:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17122:1874407346855296:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574606.524655:0:17122:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787574606.524659:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574606.524661:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574606.524662:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574606.524663:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574606.524665:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574606.524666:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574606.524667:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574606.524669:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574606.524671:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574606.524672:0:17122:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787574606.524685:0:17122:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787574606.528998:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346855424 00000100:00100000:0.0:1787574606.529678:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346855424 00000100:00100000:0.0:1787574606.530084:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574606.530107:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:17159:x1874407346855424:12345-0@lo:104: 00010000:00010000:0.0:1787574606.530126:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.530235:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574606.530260:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:17159:x1874407346855424:12345-0@lo:104: Request processed in 166us (5737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574606.530267:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787574606.531984:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574606.531997:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.532008:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabe00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574606.532047:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.532058:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574606.532066:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574606.532072:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574606.532131:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.532137:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574606.532160:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.532177:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca502fabe00/0xd18a1efeeddb9077 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb907e expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574606.532201:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574606.532203:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574606.532205:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574606.532259:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346855552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574606.532317:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574606.534686:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346855552 00000100:00100000:3.0:1787574606.534701:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346855552 00010000:00010000:3.0:1787574606.534736:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca40409ca00/0xd18a1efeeddb907e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9077 expref: 12 pid: 17137 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574606.535169:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574606.535180:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:3634:x1874407346855552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574606.535194:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574606.535200:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca40409ca00/0xd18a1efeeddb907e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9077 expref: 12 pid: 17137 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.535213:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca40409ca00/0xd18a1efeeddb907e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9077 expref: 12 pid: 17137 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.535235:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.535304:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787574606.535319:0:17128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010946088s 00010000:00010000:3.0:1787574606.535324:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.535330:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.535337:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.535343:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.535348:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574606.535352:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.535360:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.535369:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574606.535380:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574606.535701:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:3634:x1874407346855552:12345-0@lo:103:ldlm_bl.0 Request processed in 522us (3382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574606.535709:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574606.536048:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346855552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574606.540357:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409ca00/0xd18a1efeeddb907e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9077 expref: 11 pid: 17137 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574606.540375:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346855424:0@lo:104: 00010000:00010000:2.0:1787574606.540397:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.540412:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.540418:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574606.540425:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb90af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787574606.555603:0:17122:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787574606.556282:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787574606.556420:0:17183:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787574606.556424:0:17183:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787574606.561271:0:17184:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787574606.561310:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1787574606.562198:0:17185:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9ca4040a6300 x1874407346855680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574606.562212:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00000040:01000000:3.0:1787574606.562432:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787574606.562469:0:17122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787574606.563019:0:17122:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787574606.563029:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787574606.563069:0:17122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574606.564503:0:17184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574606.566573:0:17122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787574606.567947:0:17122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787574606.567992:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787574606.568992:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787574606.569058:0:17184:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:3.0:1787574606.571222:0:17122:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1787574606.573270:0:17122:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787574606.577989:0:17122:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787574606.578111:0:17122:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7bcc0da3988 00100000:10000000:2.0:1787574606.578120:0:17122:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787574606.579552:0:17122:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787574606.579568:0:17122:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787574606.579586:0:17122:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787574606.579604:0:17122:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787574606.582635:0:17122:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574606.583708:0:17122:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574607.217440:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574607.537779:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574607.603611:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 10000000:01000000:3.0:1787574608.178914:0:17139:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787574608.178926:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca53f52b800 from 7 10000000:01000000:3.0:1787574608.178932:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787574608.179660:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574608.179676:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574608.179689:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574608.180061:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346855808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574608.180672:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574608.180745:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346855808 00000100:00100000:3.0:1787574608.180756:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535071d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574608.180761:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346855808 00000100:00100000:0.0:1787574608.180840:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574608.180849:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+11:17139:x1874407346855808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574608.180866:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574608.180885:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409de00/0xd18a1efeeddb90bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb90b6 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574608.180914:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409de00/0xd18a1efeeddb90bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb90b6 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574608.180926:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409de00/0xd18a1efeeddb90bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb90b6 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574608.180937:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409de00, rc 0) 00000100:00100000:0.0:1787574608.181022:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17139:x1874407346855808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574608.181040:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787574608.181112:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346855808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574608.181134:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574608.181146:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574608.181218:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346855936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787574608.181285:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574608.181316:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535071d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574608.184171:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346855936 00000100:00100000:0.0:1787574608.184186:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346855936 00000100:00100000:0.0:1787574608.184274:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574608.184284:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17139:x1874407346855936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787574608.184310:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787574608.184330:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787574608.184334:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787574608.184464:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17139:x1874407346855936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 181us (3178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574608.184472:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574608.184532:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346855936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787574608.184596:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787574608.184607:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574608.184618:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574608.243224:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787574608.565613:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787574608.627971:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:3.0:1787574609.266567:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574609.652393:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:1.0:1787574610.299097:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574610.673626:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:3.0:1787574611.313341:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574611.712867:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787574611.712874:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787574611.712878:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574611.712886:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 545 00000100:00080000:3.0:1787574611.712892:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787574611.712899:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ca51ebe7800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574611.712923:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5c700 x1874407346856192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574611.712941:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574611.712952:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574611.712955:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574611.712958:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574611.712961:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787574611.712964:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787574611.712966:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca403184800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574611.712971:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ca403184800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574611.712985:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5ca80 x1874407346856320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574611.713015:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346856064:0@lo:400:kworker.0 00000100:00100000:3.0:1787574611.713097:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574611.713161:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346856192:0@lo:38:kworker.0 00000100:00100000:3.0:1787574611.713189:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574611.713216:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346856320:0@lo:38:kworker.0 00000100:00100000:3.0:1787574611.713259:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574611.715932:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00000100:00100000:0.0:1787574611.715981:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346856064 00000100:00100000:0.0:1787574611.715992:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346856064 00000100:00100000:0.0:1787574611.716063:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574611.716074:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:3635:x1874407346856064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574611.716163:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:3635:x1874407346856064:12345-0@lo:400:kworker.0 Request processed in 90us (3066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574611.716180:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574611.716235:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346856064:0@lo:400:kworker.0 00000100:00100000:1.0:1787574611.718142:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346856192 00000100:00100000:1.0:1787574611.718154:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346856192 00000100:00100000:1.0:1787574611.718208:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574611.718215:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346856192:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787574611.718235:0:17149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787574611.752092:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346856192:12345-0@lo:38:kworker.0 Request processed in 33867us (38892us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787574611.752108:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574611.752173:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346856320 00000100:00100000:1.0:1787574611.752183:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346856320 00000100:00100000:1.0:1787574611.752215:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574611.752222:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874407346856320:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787574611.752269:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1787574611.752308:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd18a1efeeddb90c4 00000004:00100000:1.0:1787574611.752323:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787574611.752459:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9ca5205ae800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574611.752500:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874407346856320:12345-0@lo:38:kworker.0 Request processed in 278us (39241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574611.752506:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787574611.753217:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574611.753223:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787574611.753228:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346856192:0@lo:38:kworker.0 00010000:00080000:3.0:1787574611.753267:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ca53be5ca80 x1874407346856320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787574611.753282:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787574611.753289:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787574611.753293:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787574611.753309:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca403184800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787574611.753313:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346856320:0@lo:38:kworker.0 00000001:02000400:0.0:1787574611.863923:0:17428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787574612.339436:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574612.724372:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00000020:00000004:1.0:1787574613.145917:0:17480:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574613.147208:0:17480:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574613.362783:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574613.745542:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00000020:00000004:3.0:1787574613.919512:0:17530:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574613.919977:0:17530:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787574614.386609:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574614.769581:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:0.0:1787574615.410399:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574615.793461:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:0.0:1787574616.435701:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574616.819990:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346856448:0@lo:400:kworker.0 00000100:00100000:2.0:1787574616.820095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574616.820207:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346856448 00000100:00100000:3.0:1787574616.820217:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346856448 00000100:00100000:3.0:1787574616.820293:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787574616.820304:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:3636:x1874407346856448:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787574616.820386:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787574616.820392:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787574616.820396:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574616.820402:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 550 00000100:00080000:0.0:1787574616.820407:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787574616.820412:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ca51ebe7800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574616.820436:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca40423a300 x1874407346856576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574616.820455:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574616.820459:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574616.820462:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574616.820466:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574616.821033:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00000100:00100000:1.0:1787574616.821530:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346856704:0@lo:400:kworker.0 00000100:00100000:1.0:1787574616.821965:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574616.830133:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:3636:x1874407346856448:12345-0@lo:400:kworker.0 Request processed in 9814us (10022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574616.830154:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574616.830315:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574606/real 1787574606] req@ffff9ca40429b100 x1874407346853248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574616.830379:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca40429b100 x1874407346853248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574616.831498:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574606/real 1787574606] req@ffff9ca404298e00 x1874407346853120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574616.831516:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca404298e00 x1874407346853120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574616.831548:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346856576:0@lo:38:kworker.0 00000100:00100000:1.0:1787574616.831711:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787574616.831752:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787574616.831763:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787574616.831768:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346853248:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787574616.831774:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787574616.831780:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787574616.831783:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346853120:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787574616.844091:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346856576 00000100:00100000:3.0:1787574616.844113:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346856576 00000100:00100000:3.0:1787574616.844179:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574616.844189:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1874407346856576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787574616.844215:0:17148:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1787574616.847386:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574616.847399:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787574616.847403:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574616.847413:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 545 00000100:00080000:0.0:1787574616.847420:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787574616.847439:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ca51ebe0800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574616.847490:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404239180 x1874407346856832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574616.847519:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574616.847522:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787574616.847524:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574616.847529:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 545 00000100:00080000:0.0:1787574616.847531:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787574616.847535:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca4037f4000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574616.847551:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca40423a680 x1874407346856960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574616.847601:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346856832:0@lo:8:kworker.0 00000400:00000100:0.0:1787574616.847677:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346856832 offset 0 length 520: 4 00000100:00100000:0.0:1787574616.847730:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346856960:0@lo:8:kworker.0 00000400:00000100:0.0:1787574616.847751:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346856960 offset 0 length 520: 4 00000100:00100000:2.0:1787574616.856927:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346856448:0@lo:400:kworker.0 00000100:00100000:2.0:1787574616.857028:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346856704 00000100:00100000:2.0:1787574616.857045:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346856704 00000100:00100000:2.0:1787574616.857129:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574616.857139:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346856704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574616.857274:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346856704:12345-0@lo:400:kworker.0 Request processed in 135us (35309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574616.857302:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787574616.857350:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ca404238380 x1874407346856704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574616.857365:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346856704:0@lo:400:kworker.0 00000100:00100000:3.0:1787574616.885819:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1874407346856576:12345-0@lo:38:kworker.0 Request processed in 41618us (54096us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787574616.885840:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787574616.886625:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574616.886633:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787574616.886639:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346856576:0@lo:38:kworker.0 00010000:00010000:0.0:1787574617.457542:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574617.841626:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:0.0:1787574618.482439:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574618.814605:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787574618.866421:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:0.0:1787574619.512835:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574619.889368:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:3.0:1787574620.536223:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574620.916792:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:1.0:1787574621.555188:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574621.939218:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346857088:0@lo:400:kworker.0 00000100:00100000:1.0:1787574621.939448:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787574621.942865:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787574621.942885:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787574621.942890:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574621.942899:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 556 00000100:00080000:0.0:1787574621.942906:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787574621.942913:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ca51ebe7800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574621.942979:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404239c00 x1874407346857216/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574621.943010:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574621.943015:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574621.943018:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574621.943021:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787574621.944079:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346857088 00000100:00100000:3.0:1787574621.944090:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346857088 00000100:00100000:3.0:1787574621.944202:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787574621.944212:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:3634:x1874407346857088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574621.950676:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346857344:0@lo:400:kworker.0 00000100:00100000:0.0:1787574621.950757:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574621.950822:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346857216:0@lo:38:kworker.0 00000100:00100000:0.0:1787574621.950856:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574621.950908:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346857216 00000100:00100000:0.0:1787574621.950916:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346857216 00000100:00100000:0.0:1787574621.950953:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574621.950971:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346857216:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787574621.950994:0:17149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787574621.961499:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00000100:00100000:3.0:1787574621.963498:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:3634:x1874407346857088:12345-0@lo:400:kworker.0 Request processed in 19277us (24040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574621.963533:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787574621.968836:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346857344 00000100:00100000:3.0:1787574621.968852:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346857344 00000100:00100000:3.0:1787574621.968919:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574621.968931:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346857344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574621.969062:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346857344:12345-0@lo:400:kworker.0 Request processed in 133us (18305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574621.969069:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574621.973481:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346857088:0@lo:400:kworker.0 00010000:00080000:1.0:1787574621.974818:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ca40423b800 x1874407346857344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574621.974835:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346857344:0@lo:400:kworker.0 00000100:00100000:0.0:1787574621.979884:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346857216:12345-0@lo:38:kworker.0 Request processed in 28895us (29010us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787574621.979900:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787574621.980183:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574621.980189:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787574621.980193:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346857216:0@lo:38:kworker.0 00000020:01000004:2.0:1787574622.284779:0:17875:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787574622.284783:0:17875:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787574622.284784:0:17875:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787574622.285767:0:17875:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ca4033ba000 00000020:01000004:2.0:1787574622.285789:0:17875:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1787574622.285801:0:17875:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787574622.285816:0:17875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9ca402223370) 00000020:00000080:2.0:1787574622.285832:0:17875:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787574622.387273:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787574622.388729:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787574622.390573:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787574622.391746:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787574622.392325:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787574622.392573:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787574622.392923:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787574622.393129:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787574622.393423:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787574622.393945:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787574622.394727:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787574622.394997:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787574622.395753:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787574622.396009:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787574622.403160:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787574622.403556:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787574622.405859:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787574622.406287:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787574622.406626:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.406836:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1787574622.407368:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.414367:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.414711:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787574622.414939:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787574622.415155:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.415399:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.415602:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787574622.416034:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.417010:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.417293:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787574622.418028:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.418304:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.418508:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.419068:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787574622.419344:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787574622.419964:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787574622.424121:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1787574622.425284:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787574622.425582:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.425829:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787574622.426097:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787574622.427576:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787574622.427942:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787574622.428360:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787574622.429371:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787574622.429620:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00080000:01000000:2.0:1787574622.433466:0:17875:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787574622.433710:0:17875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787574622.433720:0:17875:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787574622.433732:0:17875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb90d2 00000020:01000004:2.0:1787574622.433739:0:17875:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787574622.433760:0:17875:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787574622.433763:0:17875:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787574622.433769:0:17875:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787574622.433802:0:17875:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787574622.433806:0:17875:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787574622.463113:0:17875:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787574622.463175:0:17875:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787574622.463180:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787574622.463182:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787574622.463183:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574622.463184:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574622.463185:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574622.463186:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574622.463188:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787574622.463189:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574622.463191:0:17875:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787574622.463195:0:17875:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787574622.463197:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787574622.463198:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787574622.463199:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574622.463200:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574622.463201:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574622.463202:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574622.463203:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787574622.463204:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574622.463205:0:17875:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787574622.463235:0:17875:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787574622.463330:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346857472:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787574622.463408:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.463458:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c30cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574622.463718:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346857472 00000100:00100000:0.0:1787574622.463726:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346857472 00000100:00100000:0.0:1787574622.463783:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787574622.463793:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17875:x1874407346857472:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787574622.463836:0:17136:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787574622.463839:0:17136:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1787574622.463851:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787574622.464284:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17875:x1874407346857472:12345-0@lo:253:mount.lustre.0 Request processed in 491us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574622.464294:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787574622.466235:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346857472:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787574622.466268:0:17875:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787574622.466271:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787574622.466273:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787574622.466274:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574622.466275:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574622.466276:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574622.466277:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574622.466278:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787574622.466280:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574622.466294:0:17875:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787574622.466315:0:17875:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca4033ba000 from lustre-MDT0001 10000000:01000000:1.0:1787574622.466346:0:17875:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787574622.466348:0:17875:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787574622.466355:0:17875:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ca4024c99b8 local copy 00010000:00010000:1.0:1787574622.466365:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574622.466468:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346857600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574622.466519:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.466564:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574622.466634:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346857600 00000100:00100000:3.0:1787574622.466641:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346857600 00000100:00100000:3.0:1787574622.466684:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787574622.466694:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17875:x1874407346857600:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574622.466771:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17875:x1874407346857600:12345-0@lo:501:mount.lustre.0 Request processed in 78us (251us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574622.466779:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787574622.466904:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346857600:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787574622.466917:0:17875:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787574622.466933:0:17875:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787574622.466939:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.466948:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574622.466982:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca4033ba000 10000000:01000000:1.0:1787574622.466986:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787574622.466991:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ca4024c99b8 10000000:01000000:1.0:1787574622.466994:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787574622.466998:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ca4024c99b8 from 1 10000000:01000000:1.0:1787574622.467001:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787574622.467025:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19600/0xd18a1efeeddb90d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.467045:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca509e19600/0xd18a1efeeddb90d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.467061:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca509e19600/0xd18a1efeeddb90d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574622.467074:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346857728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574622.467099:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.467127:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574622.467415:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346857728 00000100:00100000:3.0:1787574622.467421:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346857728 00000100:00100000:3.0:1787574622.467456:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787574622.467463:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+12:17875:x1874407346857728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574622.467472:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574622.467485:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421faa00/0xd18a1efeeddb90e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb90d9 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.467505:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421faa00/0xd18a1efeeddb90e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb90d9 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.467515:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421faa00/0xd18a1efeeddb90e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb90d9 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.467524:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421faa00, rc 0) 00000100:00100000:3.0:1787574622.467567:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+13:17875:x1874407346857728:12345-0@lo:101:mount.lustre.0 Request processed in 105us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.467580:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787574622.467697:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346857728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574622.467711:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca509e19600/0xd18a1efeeddb90d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90e0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.467719:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19600/0xd18a1efeeddb90d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb90e0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574622.467733:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787574622.467749:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19600/0xd18a1efeeddb90d9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90e0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.467757:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca509e19600/0xd18a1efeeddb90d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90e0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574622.467765:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ca4033ba000 10000000:01000000:1.0:1787574622.467769:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787574622.467772:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ca4033ba000 from 1 10000000:01000000:1.0:1787574622.467773:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787574622.467787:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.467794:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.467807:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574622.467821:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346857856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574622.467847:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.467883:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574622.467987:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346857856 00000100:00100000:0.0:1787574622.467992:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346857856 00000100:00100000:0.0:1787574622.468027:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787574622.468042:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+13:17875:x1874407346857856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574622.468050:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574622.468059:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409c200/0xd18a1efeeddb90ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb90e7 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574622.468074:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409c200/0xd18a1efeeddb90ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb90e7 expref: 14 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574622.468082:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409c200/0xd18a1efeeddb90ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb90e7 expref: 14 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574622.468089:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c200, rc 0) 00000100:00100000:0.0:1787574622.468118:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+14:17875:x1874407346857856:12345-0@lo:101:mount.lustre.0 Request processed in 77us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574622.468124:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787574622.468341:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346857856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574622.468352:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.468360:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574622.468370:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787574622.468374:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.468382:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574622.468388:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787574622.468391:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787574622.468395:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ca4033ba000 10000000:01000000:1.0:1787574622.468398:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787574622.468401:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787574622.468403:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787574622.468416:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.468429:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.468437:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574622.468450:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346857984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574622.468473:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.468485:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574622.468536:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346857984 00000100:00100000:0.0:1787574622.468541:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346857984 00000100:00100000:0.0:1787574622.468572:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787574622.468579:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+14:17875:x1874407346857984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574622.468587:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574622.468595:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409d400/0xd18a1efeeddb90fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb90f5 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574622.468620:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409d400/0xd18a1efeeddb90fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb90f5 expref: 15 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574622.468628:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409d400/0xd18a1efeeddb90fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb90f5 expref: 15 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574622.468635:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d400, rc 0) 00000100:00100000:0.0:1787574622.468661:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+15:17875:x1874407346857984:12345-0@lo:101:mount.lustre.0 Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574622.468667:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787574622.468833:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346857984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574622.468843:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574622.468852:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574622.472649:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1787574622.475671:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574622.483206:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787574622.483332:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1787574622.483347:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1787574622.483360:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1787574622.483373:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1787574622.483386:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1787574622.483401:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1787574622.483414:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1787574622.483426:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1787574622.483438:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1787574622.483463:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1787574622.483477:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1787574622.483490:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1787574622.483502:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1787574622.483514:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1787574622.483527:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1787574622.483539:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1787574622.483552:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1787574622.483565:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1787574622.483578:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787574622.483593:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787574622.483606:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787574622.483619:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787574622.483646:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1787574622.483651:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1787574622.483762:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346858112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574622.483827:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.484018:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51e9a1000 going to sleep for 11 seconds 00000100:00100000:3.0:1787574622.484219:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346858112 00000100:00100000:3.0:1787574622.484228:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346858112 00000100:00100000:3.0:1787574622.484452:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787574622.484461:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+15:17875:x1874407346858112:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574622.484605:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+15:17875:x1874407346858112:12345-0@lo:501:mount.lustre.0 Request processed in 144us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.484613:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787574622.484731:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346858112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574622.484765:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346858240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574622.484807:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.484837:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51e9a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574622.484888:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346858240 00000100:00100000:0.0:1787574622.484893:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346858240 00000100:00100000:0.0:1787574622.484925:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574622.484932:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+15:17875:x1874407346858240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574622.487379:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+15:17875:x1874407346858240:12345-0@lo:503:mount.lustre.0 Request processed in 2438us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574622.487392:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787574622.487686:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346858240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787574622.488155:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787574622.488235:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346858368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574622.488306:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.488335:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51e9a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574622.488461:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346858368 00000100:00100000:0.0:1787574622.488469:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346858368 00000100:00100000:0.0:1787574622.488514:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574622.488523:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+15:17875:x1874407346858368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574622.489744:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+15:17875:x1874407346858368:12345-0@lo:502:mount.lustre.0 Request processed in 1216us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574622.489756:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574622.492066:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346858368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574622.492332:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787574622.492366:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1787574622.492379:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1787574622.492393:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1787574622.492405:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1787574622.492418:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1787574622.492430:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1787574622.492443:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1787574622.492456:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1787574622.492469:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1787574622.492481:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1787574622.492493:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1787574622.492506:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1787574622.492518:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1787574622.492531:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1787574622.492544:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1787574622.492557:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1787574622.492569:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1787574622.492581:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1787574622.492593:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1787574622.492605:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1787574622.492617:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1787574622.492630:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1787574622.492643:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1787574622.492655:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1787574622.492669:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1787574622.492682:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1787574622.492695:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1787574622.492708:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1787574622.492721:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1787574622.492733:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1787574622.492745:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1787574622.492779:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1787574622.492794:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1787574622.492805:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1787574622.492818:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1787574622.492830:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1787574622.492842:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1787574622.492855:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1787574622.496997:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1787574622.497074:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1787574622.497091:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1787574622.497105:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1787574622.497118:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1787574622.497223:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346858496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574622.497482:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574622.497559:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5203ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574622.502992:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346858496 00000100:00100000:0.0:1787574622.503007:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346858496 00000100:00100000:1.0:1787574622.504146:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574622.504161:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+15:17875:x1874407346858496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574622.504384:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+15:17875:x1874407346858496:12345-0@lo:502:mount.lustre.0 Request processed in 226us (6902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574622.504391:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787574622.504489:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346858496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574622.504575:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1787574622.504587:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1787574622.507589:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574622.507605:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574622.507607:0:17879:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787574622.507613:0:17879:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787574622.507616:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574622.507638:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9ca52eea8000) 00000020:00000080:2.0:1787574622.507658:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787574622.507666:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787574622.507735:0:17879:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787574622.507742:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb910a 00000020:00000080:2.0:1787574622.507974:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787574622.507979:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574622.507983:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574622.507984:0:17879:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787574622.507987:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574622.507990:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574622.507991:0:17879:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787574622.507995:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574622.508001:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9ca52eeacd28) 00000020:00000080:2.0:1787574622.508012:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1787574622.508016:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787574622.508019:0:17879:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787574622.508021:0:17879:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787574622.508027:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787574622.508073:0:17879:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca4033ba000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787574622.508086:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9ca52eea99b8) 00000020:00000080:2.0:1787574622.508094:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1787574622.508314:0:17879:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787574622.508321:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb911f 00000020:00000080:2.0:1787574622.508410:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787574622.508417:0:17879:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787574622.508421:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd18a1efeeddb9126 00080000:01000000:2.0:1787574622.508427:0:17879:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787574622.508430:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb912d 00010000:00010000:3.0:1787574622.577524:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574622.603848:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1787574622.606512:0:17879:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1787574622.606896:0:17879:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787574622.616557:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787574622.616571:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574622.616580:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574622.616583:0:17879:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787574622.616586:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574622.616592:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574622.616594:0:17879:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787574622.616597:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787574622.616602:0:17879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:3.0:1787574622.616630:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787574622.616646:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9ca4024c8000) 00000020:00000080:3.0:1787574622.616667:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787574622.616679:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787574622.616766:0:17879:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787574622.616772:0:17879:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787574622.616779:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb913b 00010000:00080000:3.0:1787574622.616808:0:17879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca534a3d800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1787574622.618497:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1787574622.622224:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787574622.622565:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787574622.622609:0:17879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787574622.622634:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb9142 00000100:00080000:2.0:1787574622.622645:0:17879:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787574622.622651:0:17879:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ca534a3d800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574622.622684:0:17879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca40429b480 x1874407346858624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574622.622752:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346858624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787574622.622820:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787574622.622898:0:17879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787574622.622929:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574622.622934:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574622.622937:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574622.622940:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1787574622.623013:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574622.623017:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574622.623020:0:17879:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787574622.623023:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787574622.623026:0:17879:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787574622.623028:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787574622.623030:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787574622.623032:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787574622.623034:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574622.623044:0:17879:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787574622.623047:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574622.623052:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574622.623054:0:17879:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787574622.623058:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787574622.623092:0:17879:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787574622.623105:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574622.623108:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574622.623109:0:17879:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787574622.623112:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787574622.623114:0:17879:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1787574622.623115:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787574622.623117:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787574622.623119:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787574622.623121:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574622.623123:0:17879:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787574622.623125:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787574622.623128:0:17879:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787574622.623132:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574622.623133:0:17879:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787574622.623136:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787574622.623139:0:17879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:2.0:1787574622.623161:0:17879:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787574622.623164:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574622.623176:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ca52eeab370) 00000020:00000080:2.0:1787574622.623187:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787574622.623192:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1787574622.623420:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346858624 00000100:00100000:3.0:1787574622.623428:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346858624 00000100:00100000:3.0:1787574622.623461:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574622.623468:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1874407346858624:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787574622.623491:0:17148:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:3.0:1787574622.623522:0:17148:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb9150 00000004:00100000:3.0:1787574622.623535:0:17148:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787574622.623540:0:17148:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000004:00080000:2.0:1787574622.623736:0:17879:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787574622.623743:0:17879:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787574622.623749:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb9157 00010000:00080000:2.0:1787574622.623779:0:17879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca536be9800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1787574622.624182:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1787574622.625405:0:17879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787574622.625661:0:17879:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787574622.630717:0:17879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574622.631584:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787574622.631754:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1787574622.632235:0:17884:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787574622.632504:0:17884:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787574622.633186:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787574622.633198:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787574622.633236:0:17879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787574622.633477:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb915e 00000100:00080000:0.0:1787574622.633488:0:17879:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787574622.633493:0:17879:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ca536be9800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574622.633531:0:17879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca40423b100 x1874407346858752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574622.633588:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346858752:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787574622.633653:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346858752 offset 0 length 520: 4 00000100:00080000:0.0:1787574622.633710:0:17879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787574622.633770:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574622.633774:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574622.633777:0:17879:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787574622.633779:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787574622.633782:0:17879:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787574622.633784:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787574622.633785:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787574622.633787:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787574622.633789:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574622.633791:0:17879:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787574622.633793:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787574622.633797:0:17879:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787574622.633800:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574622.633802:0:17879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787574622.633804:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787574622.633808:0:17879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:0.0:1787574622.633827:0:17879:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787574622.633829:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787574622.633845:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ca5350b99b8) 00000020:00000080:0.0:1787574622.633858:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787574622.633862:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787574622.634100:0:17879:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787574622.634107:0:17879:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787574622.634114:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb916c 00010000:00080000:0.0:1787574622.634141:0:17879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca4033de800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.140@tcp at head 00000100:00080000:1.0:1787574622.634399:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574622.634404:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787574622.634406:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574622.634409:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787574622.634652:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787574622.634722:0:17879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787574622.634737:0:17879:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1787574622.637714:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9ca53f4a4000 : changing import state from RECOVER to FULL 00000040:00080000:0.0:1787574622.643406:0:17879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574622.643832:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787574622.643975:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787574622.644514:0:17886:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787574622.644519:0:17886:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787574622.645403:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787574622.645416:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787574622.645456:0:17879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787574622.645477:0:17879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb9173 00000100:00080000:1.0:1787574622.645495:0:17879:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574622.645500:0:17879:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca4033de800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574622.645536:0:17879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca4040a5880 x1874407346858880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574622.645555:0:17879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787574622.645675:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1874407346858624:12345-0@lo:38:llog_process_th.0 Request processed in 22202us (22851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.645687:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:1.0:1787574622.646324:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574622.646330:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.646332:0:17879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787574622.646335:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574622.646339:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.646340:0:17879:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787574622.646343:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574622.646345:0:17879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787574622.646347:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574622.646350:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.646351:0:17879:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787574622.646354:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574622.646356:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.646357:0:17879:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787574622.646361:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787574622.646387:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574622.646390:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.646391:0:17879:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787574622.646394:0:17879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1787574622.646892:0:17875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787574622.646919:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787574622.646936:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.646946:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574622.646965:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca4033ba000 from 1 10000000:01000000:3.0:1787574622.646968:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787574622.647007:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.647025:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.647047:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574622.647069:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574622.647135:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574622.647169:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5203ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574622.647194:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346859008 00000100:00100000:3.0:1787574622.647201:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346859008 00000100:00100000:3.0:1787574622.647260:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787574622.647270:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+15:17875:x1874407346859008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574622.647281:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574622.647293:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9181 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb917a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.647315:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb917a expref: 16 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.647325:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb917a expref: 16 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.647333:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa000, rc 0) 00000100:00100000:3.0:1787574622.647367:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+16:17875:x1874407346859008:12345-0@lo:101:mount.lustre.0 Request processed in 99us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.647373:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787574622.647425:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574622.647439:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.647449:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574622.647945:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859136:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787574622.647993:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574622.648010:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5203ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574622.648027:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346859136 00000100:00100000:3.0:1787574622.648031:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346859136 00000100:00100000:3.0:1787574622.648053:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787574622.648060:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+16:17875:x1874407346859136:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787574622.648073:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787574622.648087:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787574622.648091:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787574622.648159:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+16:17875:x1874407346859136:12345-0@lo:256:mount.lustre.0 Request processed in 98us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.648166:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787574622.648200:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859136:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787574622.648773:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787574622.648789:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.648798:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574622.648818:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca4033ba000 from 1 10000000:01000000:3.0:1787574622.648820:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574622.648842:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.648850:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.648859:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574622.648873:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574622.648903:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574622.648917:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5203ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574622.648938:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346859264 00000100:00100000:3.0:1787574622.648942:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346859264 00000100:00100000:3.0:1787574622.648981:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787574622.648987:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+16:17875:x1874407346859264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574622.648996:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574622.649006:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb918f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9188 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.649024:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb918f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9188 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.649034:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb918f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9188 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.649052:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb200, rc 0) 00000100:00100000:3.0:1787574622.649080:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17875:x1874407346859264:12345-0@lo:101:mount.lustre.0 Request processed in 93us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.649087:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787574622.649121:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574622.649133:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.649142:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574622.649273:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574622.649301:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574622.649326:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574622.649340:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574622.649353:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346859392 00000100:00100000:3.0:1787574622.649357:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346859392 00000100:00100000:3.0:1787574622.649377:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574622.649383:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17875:x1874407346859392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574622.649453:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17875:x1874407346859392:12345-0@lo:501:mount.lustre.0 Request processed in 69us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.649460:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574622.649489:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574622.649512:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574622.649555:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574622.649567:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574622.649579:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346859520 00000100:00100000:3.0:1787574622.649582:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346859520 00000100:00100000:3.0:1787574622.649601:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574622.649607:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17875:x1874407346859520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574622.649679:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17875:x1874407346859520:12345-0@lo:503:mount.lustre.0 Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.649686:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574622.649724:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574622.650312:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574622.650322:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787574622.650330:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787574622.650335:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787574622.650340:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca534a3d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787574622.650354:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346858624:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787574622.650374:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346858880:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787574622.650403:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346858880 offset 0 length 520: 4 00000100:00080000:0.0:1787574622.650583:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574622.650588:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574622.650591:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574622.650594:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574622.651554:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574622.651570:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346859648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574622.651617:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574622.651692:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346859648 00000100:00100000:2.0:1787574622.651699:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346859648 00000100:00100000:2.0:1787574622.651751:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574622.651760:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346859648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574622.651790:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787574622.651834:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346859648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574622.651840:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574622.651916:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346859648:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787574622.653896:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574622.654237:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574622.654480:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574622.654521:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507eac600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574622.654566:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346859776 00000100:00100000:0.0:1787574622.654573:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346859776 00000100:00100000:0.0:1787574622.654620:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574622.654629:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17875:x1874407346859776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574622.654743:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17875:x1874407346859776:12345-0@lo:502:mount.lustre.0 Request processed in 115us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574622.654751:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787574622.654838:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574622.655224:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787574622.655291:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1787574622.655305:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1787574622.655318:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1787574622.655331:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1787574622.655343:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1787574622.655356:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1787574622.655371:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1787574622.655384:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787574622.655396:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1787574622.655409:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1787574622.655438:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574622.655480:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.655505:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51e9a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787574622.655576:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346859904 00000100:00100000:2.0:1787574622.655581:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346859904 00000100:00100000:2.0:1787574622.655613:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787574622.655621:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17875:x1874407346859904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574622.655724:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17875:x1874407346859904:12345-0@lo:502:mount.lustre.0 Request processed in 103us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574622.655731:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787574622.655840:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346859904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574622.655893:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1787574622.655901:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787574622.656563:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574622.656573:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.656575:0:17888:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787574622.656583:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca4033ba000 00000020:00000080:1.0:1787574622.656586:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574622.656593:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574622.656596:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.656598:0:17888:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787574622.656600:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574622.656603:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.656604:0:17888:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787574622.656607:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca4033ba000 00000020:00000080:1.0:1787574622.656610:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574622.656670:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574622.656674:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.656682:0:17888:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787574622.656686:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574622.656689:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.656690:0:17888:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574622.656693:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca4033ba000 00000020:00000080:1.0:1787574622.656696:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574622.656715:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574622.656718:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.656719:0:17888:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574622.656722:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574622.656724:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.656726:0:17888:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787574622.656729:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca4033ba000 00000020:00000080:1.0:1787574622.656731:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574622.656752:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574622.656755:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574622.656756:0:17888:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787574622.656759:0:17888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1787574622.664361:0:17875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787574622.664410:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787574622.664479:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574622.664494:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574622.664631:0:17875:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787574622.664635:0:17875:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca4033ba000 10000000:01000000:2.0:1787574622.664638:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca4033ba000 10000000:01000000:2.0:1787574622.664642:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787574622.664649:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca4033ba000 from 1 10000000:01000000:2.0:1787574622.664652:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787574622.664687:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574622.664696:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574622.664707:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574622.664731:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574622.664797:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574622.664837:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346860032 00000100:00100000:2.0:1787574622.664851:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346860032 00000100:00100000:2.0:1787574622.664907:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787574622.664915:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17875:x1874407346860032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574622.664927:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574622.664938:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb919d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9196 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574622.664991:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb919d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9196 expref: 18 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574622.665002:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb919d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9196 expref: 18 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574622.665011:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fab400, rc 0) 00000100:00100000:2.0:1787574622.669304:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860032:12345-0@lo:101:mount.lustre.0 Request processed in 4381us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574622.669318:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787574622.669391:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535071f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574622.669416:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574622.669440:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574622.669453:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787574622.672534:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787574622.672848:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574622.673730:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787574622.673760:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1787574622.673786:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1787574622.673801:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1787574622.673814:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1787574622.673842:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1787574622.673855:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1787574622.673883:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1787574622.673899:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1787574622.673911:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1787574622.673924:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1787574622.673936:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1787574622.673967:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1787574622.678498:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1787574622.678558:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1787574622.678573:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1787574622.678585:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1787574622.678598:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1787574622.678611:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1787574622.678623:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1787574622.678635:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1787574622.678672:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1787574622.678689:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1787574622.678702:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1787574622.678715:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1787574622.678726:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1787574622.678738:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1787574622.678750:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1787574622.678774:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1787574622.678779:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787574622.681009:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574622.681092:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574622.681148:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346860160 00000100:00100000:2.0:1787574622.681156:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346860160 00000100:00100000:2.0:1787574622.681212:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787574622.681221:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574622.681508:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860160:12345-0@lo:501:mount.lustre.0 Request processed in 287us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574622.681516:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787574622.681558:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535071780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574622.681578:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574622.681612:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574622.681647:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574622.681668:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346860288 00000100:00100000:2.0:1787574622.681672:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346860288 00000100:00100000:2.0:1787574622.681693:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574622.681699:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574622.681763:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860288:12345-0@lo:503:mount.lustre.0 Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574622.681770:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574622.681802:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535071780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574622.681813:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860288:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787574622.682776:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787574622.682848:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574622.682907:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574622.682935:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346860416 00000100:00100000:2.0:1787574622.682940:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346860416 00000100:00100000:2.0:1787574622.682991:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787574622.682999:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574622.683103:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860416:12345-0@lo:502:mount.lustre.0 Request processed in 105us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574622.683111:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787574622.683155:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535071f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574622.683172:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574622.683337:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787574622.683361:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1787574622.683373:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1787574622.683385:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1787574622.683397:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1787574622.683409:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1787574622.683434:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1787574622.683448:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1787574622.683461:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1787574622.683473:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1787574622.683484:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1787574622.683496:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1787574622.683508:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1787574622.683520:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1787574622.683532:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1787574622.683545:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1787574622.683557:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1787574622.683568:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1787574622.683580:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1787574622.683592:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1787574622.683604:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1787574622.683616:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1787574622.683639:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1787574622.683653:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1787574622.683665:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1787574622.683685:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1787574622.683699:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1787574622.683711:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1787574622.683724:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1787574622.683736:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1787574622.683748:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1787574622.683760:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1787574622.683772:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1787574622.683784:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1787574622.683797:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1787574622.683810:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1787574622.683822:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1787574622.683834:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1787574622.683855:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1787574622.683869:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1787574622.683881:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1787574622.683893:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1787574622.683905:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1787574622.683917:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1787574622.683929:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1787574622.683941:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1787574622.683968:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1787574622.683983:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1787574622.684019:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574622.684064:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574622.684102:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346860544 00000100:00100000:2.0:1787574622.684107:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346860544 00000100:00100000:2.0:1787574622.684133:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787574622.684139:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574622.684215:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860544:12345-0@lo:502:mount.lustre.0 Request processed in 73us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574622.684230:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787574622.684295:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535071f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574622.684311:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574622.684438:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1787574622.684458:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1787574622.684479:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574622.684511:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574622.684532:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346860672 00000100:00100000:2.0:1787574622.684536:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346860672 00000100:00100000:2.0:1787574622.684556:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787574622.684561:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574622.684615:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860672:12345-0@lo:502:mount.lustre.0 Request processed in 53us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574622.684622:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787574622.684652:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535071f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574622.684665:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574622.684698:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1787574622.684706:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787574622.707215:0:17892:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787574622.707414:0:17892:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9ca52e6f19b8) 00000020:00000080:2.0:1787574622.707440:0:17892:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787574622.707523:0:17892:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca4033ba000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787574622.707527:0:17892:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca4033ba000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787574622.707530:0:17892:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca4033ba000 3 00010000:00080000:2.0:1787574622.707559:0:17892:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca40270c000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1787574622.711524:0:17892:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787574622.711824:0:17892:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787574622.711916:0:17892:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787574622.711928:0:17892:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd18a1efeeddb91ab 00000100:00080000:2.0:1787574622.711937:0:17892:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787574622.711942:0:17892:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ca40270c000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574622.712067:0:17892:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404298000 x1874407346860800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574622.712105:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346860800:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787574622.712187:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574622.712280:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346860800 00000100:00100000:2.0:1787574622.712286:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346860800 00000100:00100000:2.0:1787574622.712315:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574622.712323:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874407346860800:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787574622.712344:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:2.0:1787574622.712379:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd18a1efeeddb91b2 00000004:00100000:2.0:1787574622.712392:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787574622.712418:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9ca402709800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574622.712459:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874407346860800:12345-0@lo:38:llog_process_th.0 Request processed in 135us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574622.712466:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787574622.712507:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ca404298000 x1874407346860800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574622.712516:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574622.712523:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787574622.712529:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787574622.712532:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787574622.712540:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca40270c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787574622.712545:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346860800:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787574622.712561:0:17892:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787574622.712579:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574622.712583:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574622.712586:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574622.712590:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787574622.714944:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1787574622.717475:0:17875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787574622.717526:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787574622.717551:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574622.717564:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787574622.718407:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787574622.718410:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787574622.718412:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574622.718413:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574622.718414:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574622.718416:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574622.718418:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787574622.718420:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574622.718421:0:17875:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787574622.718425:0:17875:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1787574622.718428:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787574622.718430:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787574622.718431:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574622.718432:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574622.718433:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574622.718435:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574622.718436:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787574622.718437:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574622.718438:0:17875:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787574622.718465:0:17875:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787574622.718487:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860928:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787574622.718553:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574622.719587:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509b72780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574622.721373:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346860928 00000100:00100000:2.0:1787574622.721385:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346860928 00000100:00100000:2.0:1787574622.721443:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787574622.721453:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860928:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787574622.721482:0:17135:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787574622.721497:0:17135:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787574622.732705:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787574622.736367:0:17135:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787574622.736385:0:17135:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787574622.736800:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17875:x1874407346860928:12345-0@lo:253:mount.lustre.0 Request processed in 15344us (18241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574622.736813:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787574622.736912:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17875:1874407346860928:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787574622.736927:0:17875:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787574622.736930:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787574622.736932:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787574622.736934:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574622.736935:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574622.736936:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574622.736938:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574622.736939:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787574622.736941:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574622.736958:0:17875:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787574622.736974:0:17875:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787574622.740717:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787574622.740728:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787574622.740756:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.740775:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca40409de00/0xd18a1efeeddb90bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb90b6 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.740784:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb917a expref: 17 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.740792:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.740835:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb917a expref: 17 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.740913:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9181 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb917a expref: 17 pid: 17135 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574622.740930:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346861056:0@lo:104: 00000100:00100000:3.0:1787574622.741008:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787574622.741733:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca40409de00/0xd18a1efeeddb90bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb90b6 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.741746:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca40409de00/0xd18a1efeeddb90bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb90b6 expref: 17 pid: 17137 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574622.741757:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346861184:0@lo:104: 00000100:00100000:3.0:1787574622.741785:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574622.741802:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4033ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1787574622.741842:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346861056 00000100:00100000:3.0:1787574622.741850:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346861056 00000100:00100000:3.0:1787574622.741962:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346861184 00000100:00100000:3.0:1787574622.741966:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346861184 00000100:00100000:3.0:1787574622.741982:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574622.741990:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+4:17159:x1874407346861056:12345-0@lo:104: 00010000:00010000:3.0:1787574622.742003:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742114:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574622.742121:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+4:17159:x1874407346861056:12345-0@lo:104: Request processed in 132us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.742128:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574622.742145:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574622.742161:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:17159:x1874407346861184:12345-0@lo:104: 00010000:00010000:3.0:1787574622.742169:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742200:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787574622.742206:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:17159:x1874407346861184:12345-0@lo:104: Request processed in 47us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.742213:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574622.742270:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346861056:0@lo:104: 00000100:00100000:3.0:1787574622.742280:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346861184:0@lo:104: 00010000:00010000:3.0:1787574622.742298:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742315:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574622.742320:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742327:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb800 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574622.742332:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742341:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574622.742348:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574622.742354:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574622.742382:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742395:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574622.742415:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742422:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb917a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9181 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742435:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574622.742438:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742445:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574622.742448:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742456:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574622.742463:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574622.742468:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574622.742480:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742486:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574622.742499:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742507:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb90b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb90bd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.742525:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574622.742526:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574622.742528:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574622.742545:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346861312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574622.742574:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574622.742715:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574622.742754:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346861440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574622.742778:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574622.742808:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346861312 00000100:00100000:3.0:1787574622.742812:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346861312 00010000:00010000:3.0:1787574622.742831:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9181 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb917a expref: 18 pid: 17135 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574622.742849:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346861440 00000100:00100000:3.0:1787574622.742852:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346861440 00010000:00010000:3.0:1787574622.742862:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca40409de00/0xd18a1efeeddb90bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb90b6 expref: 19 pid: 17137 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574622.743329:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574622.743338:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:3637:x1874407346861312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574622.743350:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574622.743356:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9181 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb917a expref: 19 pid: 17135 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743366:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb917a expref: 19 pid: 17135 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743381:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9181 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb917a expref: 19 pid: 17135 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743407:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574622.743494:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:3637:x1874407346861312:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.743503:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574622.743518:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574622.743525:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:3634:x1874407346861440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574622.743533:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574622.743538:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca40409de00/0xd18a1efeeddb90bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb90b6 expref: 17 pid: 17137 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743547:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca40409de00/0xd18a1efeeddb90bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb90b6 expref: 17 pid: 17137 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743557:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409de00/0xd18a1efeeddb90bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb90b6 expref: 17 pid: 17137 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743568:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743575:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787574622.743591:0:17128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010946088s 00010000:00010000:3.0:1787574622.743672:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743681:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743700:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743707:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743713:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574622.743718:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743726:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743742:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743752:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574622.743779:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+16:3634:x1874407346861440:12345-0@lo:103:ldlm_bl.0 Request processed in 255us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574622.743786:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787574622.743810:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743817:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574622.743824:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574622.743852:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346861440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574622.747347:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346861312:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1787574622.759189:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1787574622.759553:0:17899:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787574622.759558:0:17899:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787574622.760138:0:17900:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787574622.760363:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1787574622.761122:0:17901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17901:1874407346861568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787574622.761190:0:17901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574622.761226:0:17901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535071f00 going to sleep for 11 seconds 00000040:00080000:2.0:1787574622.761308:0:17900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574622.763582:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787574622.763677:0:17900:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1787574622.764626:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346861568 00000100:00100000:1.0:1787574622.764637:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346861568 00000100:00100000:1.0:1787574622.764694:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574622.764705:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17901:x1874407346861568:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787574622.764823:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17901:x1874407346861568:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 120us (3633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574622.764832:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574622.764887:0:17901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17901:1874407346861568:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787574622.764920:0:17901:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787574622.764985:0:17901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17901:1874407346861696:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787574622.765028:0:17901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.765062:0:17901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c30cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574622.765074:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346861696 00000100:00100000:1.0:1787574622.765077:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346861696 00000100:00100000:1.0:1787574622.765095:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574622.765100:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17901:x1874407346861696:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787574622.765194:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17901:x1874407346861696:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 93us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574622.765201:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574622.765225:0:17901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17901:1874407346861696:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787574622.765306:0:17901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17901:1874407346861824:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787574622.765336:0:17901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.765360:0:17901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c30cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574622.765703:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346861824 00000100:00100000:1.0:1787574622.765709:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346861824 00000100:00100000:1.0:1787574622.765732:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574622.765739:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17901:x1874407346861824:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787574622.765778:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17901:x1874407346861824:12345-0@lo:900:lod0001_rec0000.0 Request processed in 40us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574622.765785:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787574622.765810:0:17901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ca4040a5500 x1874407346861824/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787574638 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574622.765821:0:17901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17901:1874407346861824:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787574622.765858:0:17901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17901:1874407346861952:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787574622.765906:0:17901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574622.765920:0:17901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c309c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574622.765931:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346861952 00000100:00100000:1.0:1787574622.765934:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346861952 00000100:00100000:1.0:1787574622.765971:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574622.765977:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17901:x1874407346861952:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787574622.766198:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17901:x1874407346861952:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 220us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574622.766206:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574622.766231:0:17901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17901:1874407346861952:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787574622.766335:0:17901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787574622.768479:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787574622.768521:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787574622.769208:0:17875:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787574622.769219:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787574622.773024:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574622.774395:0:17901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787574622.774470:0:17901:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787574622.774474:0:17901:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:0.0:1787574622.775710:0:17875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787574622.776417:0:17875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787574622.776451:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787574622.776624:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787574622.777446:0:17875:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1787574622.782737:0:17875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787574622.794349:0:17875:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787574622.794388:0:17875:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa7bcc1627988 00100000:10000000:3.0:1787574622.794395:0:17875:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787574622.795642:0:17875:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787574622.795672:0:17875:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787574622.795692:0:17875:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787574622.795708:0:17875:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787574622.796354:0:17875:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787574622.796551:0:17875:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787574622.963811:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:1.0:1787574623.609735:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574623.794041:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787574623.987211:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 10000000:01000000:1.0:1787574624.376971:0:17139:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574624.376980:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca4033ba000 from 8 10000000:01000000:1.0:1787574624.376986:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574624.377038:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574624.377053:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574624.377070:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574624.377102:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346862080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574624.377198:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574624.377279:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca521919480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574624.377360:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346862080 00000100:00100000:2.0:1787574624.377369:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346862080 00000100:00100000:2.0:1787574624.377416:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787574624.377426:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+16:17139:x1874407346862080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574624.377445:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574624.377464:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb91c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb91c0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574624.377494:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb91c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb91c0 expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574624.377510:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb91c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb91c0 expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574624.377521:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faae00, rc 0) 00000100:00100000:2.0:1787574624.377592:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17139:x1874407346862080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574624.377599:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787574624.377877:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346862080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574624.377899:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574624.377914:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574624.377988:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346862208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787574624.378019:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574624.378055:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca521919480 going to sleep for 11 seconds 00000100:00100000:0.0:1787574624.378184:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346862208 00000100:00100000:0.0:1787574624.378190:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346862208 00000100:00100000:0.0:1787574624.378236:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787574624.378271:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17139:x1874407346862208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787574624.378286:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787574624.378303:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787574624.378307:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787574624.378396:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17139:x1874407346862208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574624.378403:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787574624.379360:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346862208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787574624.379411:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787574624.379420:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574624.379431:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574624.379441:0:17139:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574624.379444:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca53f52b800 from 8 10000000:01000000:1.0:1787574624.379447:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574624.379471:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574624.379479:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574624.379498:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574624.379515:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346862336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574624.379556:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574624.379604:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca521919480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574624.379621:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346862336 00000100:00100000:1.0:1787574624.379625:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346862336 00000100:00100000:1.0:1787574624.379661:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787574624.379670:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17139:x1874407346862336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574624.379680:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574624.379691:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb91d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb91ce expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574624.379711:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb91d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb91ce expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574624.379720:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb91d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb91ce expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574624.379728:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19800, rc 0) 00000100:00100000:1.0:1787574624.379761:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17139:x1874407346862336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574624.379767:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787574624.379800:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346862336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574624.379812:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574624.379827:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574624.380056:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346862464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787574624.380103:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574624.380160:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca521919480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574624.391179:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346862464 00000100:00100000:2.0:1787574624.391196:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346862464 00000100:00100000:2.0:1787574624.391303:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787574624.391314:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17139:x1874407346862464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787574624.391339:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787574624.391362:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787574624.391365:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787574624.391512:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17139:x1874407346862464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (11407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574624.391529:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787574624.391569:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346862464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787574624.391621:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574624.391631:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574624.391642:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574624.625464:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574624.817991:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787574625.009363:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:1.0:1787574625.649623:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574626.034375:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:0.0:1787574626.674818:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574627.062552:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00010000:00010000:2.0:1787574627.711306:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574628.018837:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787574628.083029:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574628.083054:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346862592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574628.083121:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574628.083187:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346862592 00000100:00100000:2.0:1787574628.083195:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346862592 00000100:00100000:2.0:1787574628.083288:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574628.083298:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346862592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574628.083332:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787574628.083376:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346862592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574628.083383:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574628.083426:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346862592:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787574628.085540:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787574628.085546:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787574628.085549:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574628.085557:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 561 00000100:00080000:3.0:1787574628.085561:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787574628.085568:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ca51ebe7800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574628.085589:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5fb80 x1874407346862848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574628.085604:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574628.085607:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574628.085610:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574628.085613:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574628.085623:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574628.085626:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574628.085628:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574628.085631:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787574628.085658:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574628.085679:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346863104:0@lo:400:kworker.0 00000100:00100000:3.0:1787574628.085738:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574628.085751:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346862720:0@lo:400:kworker.0 00000100:00100000:3.0:1787574628.085772:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346862976:0@lo:400:kworker.0 00000100:00100000:1.0:1787574628.085782:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574628.085793:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574628.085821:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346862848:0@lo:38:kworker.0 00000100:00100000:1.0:1787574628.085821:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 0 seconds 00000100:00100000:1.0:1787574628.085835:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346863104 00000100:00100000:1.0:1787574628.085841:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346863104 00000100:00100000:3.0:1787574628.085844:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574628.085872:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346862976 00000100:00100000:3.0:1787574628.085876:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346862976 00000100:00100000:3.0:1787574628.086005:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574628.086201:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346863104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574628.086280:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346863104:12345-0@lo:400:kworker.0 Request processed in 82us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574628.086288:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574628.086304:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574628.086442:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346862976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574628.086499:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346862976:12345-0@lo:400:kworker.0 Request processed in 57us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574628.086506:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574628.086529:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346862848 00000100:00100000:3.0:1787574628.086533:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346862848 00000100:00100000:3.0:1787574628.086551:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574628.086556:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1874407346862848:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787574628.086579:0:17148:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:3.0:1787574628.086614:0:17148:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb91dc 00000004:00100000:3.0:1787574628.086628:0:17148:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787574628.086633:0:17148:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:3.0:1787574628.086725:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca53be5e300 x1874407346863104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574628.086741:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346863104:0@lo:400:kworker.0 00010000:00080000:0.0:1787574628.086819:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca53be5ed80 x1874407346862976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574628.086828:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346862976:0@lo:400:kworker.0 00000100:00100000:1.0:1787574628.086966:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346862720 00000100:00100000:1.0:1787574628.086972:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346862720 00000100:00100000:1.0:1787574628.087007:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787574628.087015:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:3636:x1874407346862720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574628.087106:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:3636:x1874407346862720:12345-0@lo:400:kworker.0 Request processed in 91us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574628.087112:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787574628.087978:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346862720:0@lo:400:kworker.0 00000100:00080000:2.0:1787574628.098129:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9ca40270d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574628.098263:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1874407346862848:12345-0@lo:38:kworker.0 Request processed in 11703us (12415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574628.098274:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574628.099746:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787574628.099759:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787574628.099767:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787574628.099773:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787574628.099776:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787574628.099797:0:3633:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009fb06f79): req@ffff9ca4040a6300 x1874407346855680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574628.099833:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346862848:0@lo:38:kworker.0 00000100:00100000:1.0:1787574628.100092:0:17185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574628.100124:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5351cc480 going to sleep for 11 seconds 00000100:00100000:1.0:1787574628.100140:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346855680 00000100:00100000:1.0:1787574628.100146:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346855680 00000100:00100000:1.0:1787574628.100187:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574628.100195:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17185:x1874407346855680:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787574628.100282:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17185:x1874407346855680:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574628.100290:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574628.100318:0:17185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1874407346855680:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787574628.100348:0:17185:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787574628.100385:0:17185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1874407346863232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787574628.100414:0:17185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574628.100437:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb6840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574628.100446:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346863232 00000100:00100000:1.0:1787574628.100449:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346863232 00000100:00100000:2.0:1787574628.100456:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346863360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574628.100466:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574628.100471:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17185:x1874407346863232:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787574628.100483:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574628.100510:0:17148:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787574628.100517:0:17148:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1787574628.100555:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17185:x1874407346863232:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574628.100562:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574628.100571:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346863360 00000100:00100000:1.0:1787574628.100575:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346863360 00000100:00100000:1.0:1787574628.100588:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787574628.100592:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346863360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574628.101213:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787574628.101557:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346863360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 961us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574628.101565:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787574628.101603:0:17185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1874407346863232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787574628.102058:0:17185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1874407346863488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787574628.102092:0:17185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574628.102358:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb6840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574628.102459:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346863360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574628.110801:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346863488 00000100:00100000:2.0:1787574628.110817:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346863488 00000100:00100000:2.0:1787574628.110888:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574628.110899:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1874407346863488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787574628.111488:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1874407346863488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 589us (9393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574628.111497:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787574628.115084:0:17185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1874407346863488:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787574628.115162:0:17185:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574628.120381:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787574628.120467:0:17185:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:1.0:1787574628.120473:0:17185:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787574628.732358:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787574628.978027:0:18145:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787574629.745651:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787574630.153164:0:18197:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574630.154154:0:18197:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574630.780028:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574631.153330:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574616/real 1787574616] req@ffff9ca404239180 x1874407346856832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574631 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574631.153361:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca404239180 x1874407346856832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574631 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574631.153371:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574616/real 1787574616] req@ffff9ca40423a680 x1874407346856960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574631 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574631.153383:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca40423a680 x1874407346856960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574631 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787574631.153402:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574631.153419:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574631.153435:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346856832:0@lo:8:kworker.0 00000100:00080000:2.0:1787574631.153440:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574631.153445:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574631.153449:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346856960:0@lo:8:kworker.0 00000100:00100000:3.0:1787574631.153590:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574631.153603:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346863616:0@lo:400:kworker.0 00000100:00100000:3.0:1787574631.153663:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574631.153711:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346863616 00000100:00100000:3.0:1787574631.153718:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346863616 00000100:00100000:3.0:1787574631.153763:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787574631.153771:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:3637:x1874407346863616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574631.153951:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:3637:x1874407346863616:12345-0@lo:400:kworker.0 Request processed in 179us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574631.153958:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787574631.154005:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574631.154009:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787574631.154011:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574631.154015:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 556 00000100:00080000:3.0:1787574631.154019:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787574631.154024:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ca51ebe0800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574631.154042:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5c380 x1874407346863872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574631.154053:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574631.154056:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787574631.154064:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574631.154068:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 556 00000100:00080000:3.0:1787574631.154071:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787574631.154074:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca4037f4000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574631.154086:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5f800 x1874407346864000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574631.154114:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574631.154122:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346864128:0@lo:400:kworker.0 00000100:00100000:3.0:1787574631.154166:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574631.154281:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574631.154291:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346863744:0@lo:400:kworker.0 00000100:00100000:2.0:1787574631.154322:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574631.154352:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346863744 00000100:00100000:2.0:1787574631.154356:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346863744 00000100:00100000:2.0:1787574631.154392:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574631.154399:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346863744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574631.154437:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346863744:12345-0@lo:400:kworker.0 Request processed in 39us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574631.154444:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574631.154476:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346863744:0@lo:400:kworker.0 00000100:00100000:2.0:1787574631.154495:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346863616:0@lo:400:kworker.0 00000100:00100000:2.0:1787574631.154512:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346863872:0@lo:8:kworker.0 00000400:00000100:2.0:1787574631.154535:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346863872 offset 0 length 520: 4 00000100:00100000:2.0:1787574631.154552:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346864000:0@lo:8:kworker.0 00000400:00000100:2.0:1787574631.154567:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346864000 offset 0 length 520: 4 00000100:00100000:3.0:1787574631.154695:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346864128 00000100:00100000:3.0:1787574631.154699:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346864128 00000100:00100000:3.0:1787574631.154765:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574631.154773:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346864128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574631.154818:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346864128:12345-0@lo:400:kworker.0 Request processed in 46us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574631.154825:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787574631.158418:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574631.158424:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787574631.158427:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574631.158430:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574631.158478:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574631.158498:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346864256:0@lo:400:kworker.0 00000100:00100000:1.0:1787574631.158563:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574631.160995:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574631.161018:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346864384:0@lo:400:kworker.0 00000100:00100000:1.0:1787574631.161089:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574631.179657:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346864384 00000100:00100000:2.0:1787574631.179673:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346864384 00000100:00100000:2.0:1787574631.179693:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346864256 00000100:00100000:2.0:1787574631.179696:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346864256 00000100:00100000:2.0:1787574631.179749:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574631.179772:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346864256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574631.179884:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346864256:12345-0@lo:400:kworker.0 Request processed in 103us (21309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574631.179890:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574631.179936:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346864256:0@lo:400:kworker.0 00000100:00100000:2.0:1787574631.179981:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574631.179988:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346864384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574631.180027:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346864384:12345-0@lo:400:kworker.0 Request processed in 39us (18937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574631.180033:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787574631.180056:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca4040a5180 x1874407346864384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574631.180066:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346864384:0@lo:400:kworker.0 00010000:00080000:2.0:1787574631.184763:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca53be5fb80 x1874407346864128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574631.184783:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346864128:0@lo:400:kworker.0 00000020:00000004:3.0:1787574631.714359:0:18248:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574631.714545:0:18248:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574631.796456:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574632.186709:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574622/real 1787574622] req@ffff9ca4040a5880 x1874407346858880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574632 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574632.186740:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca4040a5880 x1874407346858880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574632 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574632.187132:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574622/real 1787574622] req@ffff9ca40423b100 x1874407346858752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574632 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574632.187148:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca40423b100 x1874407346858752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574632 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787574632.187167:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574632.187221:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574632.187225:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346858880:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787574632.187264:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca536be9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574632.187378:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574632.187383:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574632.187386:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574632.187395:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574632.187403:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346864512:0@lo:400:kworker.0 00000100:00080000:3.0:1787574632.187413:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574632.187416:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787574632.187418:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca536be9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574632.187422:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:3.0:1787574632.187427:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787574632.187432:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ca536be9800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574632.187449:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53be5df80 x1874407346865024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574632.187456:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574632.187458:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787574632.187460:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574632.187462:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:3.0:1787574632.187464:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787574632.187467:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca4033de800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574632.187467:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574632.187477:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404054e00 x1874407346865152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574632.187502:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346864896:0@lo:400:kworker.0 00000100:00100000:1.0:1787574632.187506:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346865280:0@lo:400:kworker.0 00000100:00100000:1.0:1787574632.187530:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574632.187562:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346864512 00000100:00100000:1.0:1787574632.187569:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346864512 00000100:00100000:1.0:1787574632.187613:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787574632.187622:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574632.187622:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:3637:x1874407346864512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574632.187651:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346864640:0@lo:400:kworker.0 00000100:00100000:1.0:1787574632.187667:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:3637:x1874407346864512:12345-0@lo:400:kworker.0 Request processed in 46us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574632.187672:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574632.187674:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787574632.187687:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574632.187692:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346864768:0@lo:400:kworker.0 00000100:00100000:3.0:1787574632.187712:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574632.187713:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346864512:0@lo:400:kworker.0 00000100:00100000:3.0:1787574632.187746:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346864896 00000100:00100000:3.0:1787574632.187750:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346864896 00000100:00100000:3.0:1787574632.187858:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346864640 00000100:00100000:3.0:1787574632.187863:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346864640 00000100:00080000:2.0:1787574632.187911:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574632.187916:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346858752:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787574632.187942:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346865280 00000100:00100000:2.0:1787574632.187945:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346865280 00000100:00100000:2.0:1787574632.187970:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346864768 00000100:00100000:2.0:1787574632.187973:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346864768 00000100:00100000:2.0:1787574632.187985:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574632.187990:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346865280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574632.188151:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346865280:12345-0@lo:400:kworker.0 Request processed in 159us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574632.188158:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574632.188171:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574632.188178:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346864768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574632.188213:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346864768:12345-0@lo:400:kworker.0 Request processed in 36us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574632.188219:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574632.188235:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346865024:0@lo:8:kworker.0 00000400:00000100:2.0:1787574632.188281:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346865024 offset 0 length 520: 4 00000100:00100000:2.0:1787574632.188299:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346865152:0@lo:8:kworker.0 00000400:00000100:2.0:1787574632.188315:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346865152 offset 0 length 520: 4 00010000:00080000:0.0:1787574632.191636:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca404055f80 x1874407346865280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574632.191656:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346865280:0@lo:400:kworker.0 00000100:00080000:0.0:1787574632.191730:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574632.191734:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574632.191737:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574632.191740:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787574632.193128:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574632.193152:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346864896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574632.193275:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346864896:12345-0@lo:400:kworker.0 Request processed in 135us (5651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574632.193290:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574632.193318:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574632.193326:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346864640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574632.193358:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346864640:12345-0@lo:400:kworker.0 Request processed in 34us (5685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574632.193365:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787574632.195306:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca53be5fb80 x1874407346864768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574632.195325:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346864768:0@lo:400:kworker.0 00000100:00100000:2.0:1787574632.195339:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346864640:0@lo:400:kworker.0 00000100:00100000:2.0:1787574632.196350:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346864896:0@lo:400:kworker.0 00010000:00010000:3.0:1787574632.821105:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787574633.028577:0:18297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd6237b10 20000000:00000080:0.0:1787574633.028594:0:18297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ca52e63c000 uarg=0000000000000000 20000000:01000000:0.0:1787574633.028637:0:18297:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787574633.028645:0:18297:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787574633.028650:0:18297:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787574633.029672:0:18298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787574633.029897:0:18297:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787574633.043902:0:18297:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787574633.043937:0:18297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574633.045439:0:18297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb908c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9085 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574633.045455:0:18297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb918f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9188 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574633.045463:0:18297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574633.045517:0:18297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb918f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9188 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574633.045543:0:18297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb918f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9188 expref: 17 pid: 17137 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574633.045558:0:18297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1874407346865408:0@lo:104: 00000100:00100000:1.0:1787574633.045626:0:18297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574633.045684:0:18297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb908c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9085 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574633.045693:0:18297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb908c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9085 expref: 17 pid: 17137 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574633.045702:0:18297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1874407346865536:0@lo:104: 00000100:00100000:1.0:1787574633.045724:0:18297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574633.047086:0:18297:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510eb6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787574633.047856:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346865408 00000100:00100000:0.0:1787574633.047878:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346865408 00000100:00100000:0.0:1787574633.047929:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346865536 00000100:00100000:0.0:1787574633.047932:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346865536 00000100:00100000:0.0:1787574633.047963:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574633.047987:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+4:18297:x1874407346865408:12345-0@lo:104: 00010000:00010000:0.0:1787574633.048008:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048111:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574633.048117:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+4:18297:x1874407346865408:12345-0@lo:104: Request processed in 133us (2491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574633.048124:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574633.048153:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574633.048159:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:18297:x1874407346865536:12345-0@lo:104: 00010000:00010000:0.0:1787574633.048168:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048205:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787574633.048211:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:18297:x1874407346865536:12345-0@lo:104: Request processed in 53us (2486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574633.048217:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787574633.048235:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574633.048257:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048265:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574633.048270:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048279:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574633.048287:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574633.048301:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574633.048335:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048342:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574633.048359:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048367:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9188 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb918f expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048381:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574633.048384:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048390:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa800 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574633.048393:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048401:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574633.048408:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574633.048413:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574633.048424:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048431:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574633.048443:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048450:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca502faa800/0xd18a1efeeddb9085 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb908c expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048463:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574633.048465:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574633.048467:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574633.048488:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346865792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574633.048529:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574633.048564:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574633.048570:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346865664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574633.048591:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574633.048633:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346865792 00000100:00100000:0.0:1787574633.048638:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346865792 00010000:00010000:0.0:1787574633.048657:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb908c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9085 expref: 18 pid: 17137 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574633.048676:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346865664 00000100:00100000:0.0:1787574633.048679:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346865664 00010000:00010000:0.0:1787574633.048689:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb918f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9188 expref: 19 pid: 17137 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574633.048700:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574633.048706:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:3635:x1874407346865792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574633.048716:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574633.048721:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb908c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9085 expref: 19 pid: 17137 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048741:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb908c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9085 expref: 19 pid: 17137 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048759:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574633.048789:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:3635:x1874407346865792:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574633.048796:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574633.048809:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574633.048814:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:3635:x1874407346865664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574633.048822:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574633.048827:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb918f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9188 expref: 18 pid: 17137 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048836:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb918f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9188 expref: 18 pid: 17137 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048848:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048855:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048881:0:17129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048888:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048895:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048908:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048912:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574633.048916:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048923:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048932:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574633.048942:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574633.048967:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:3635:x1874407346865664:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574633.048972:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574633.049011:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346865664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574633.049020:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346865792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574633.050956:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574633.051328:0:18297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb918f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9188 expref: 17 pid: 17137 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574633.051349:0:18297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1874407346865408:0@lo:104: 00010000:00010000:1.0:1787574633.051362:0:18297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb908c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9085 expref: 16 pid: 17137 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574633.051368:0:18297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1874407346865536:0@lo:104: 00010000:00010000:1.0:1787574633.051393:0:18297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574633.051403:0:18297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574633.051428:0:18297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574633.051435:0:18297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75600/0xd18a1efeeddb91e3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574633.201503:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346865920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574633.201578:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574633.201671:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346865920 00000100:00100000:2.0:1787574633.201679:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346865920 00000100:00100000:2.0:1787574633.201734:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787574633.201744:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346865920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574633.201788:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574633.201840:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346865920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574633.201847:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787574633.201904:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346865920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574633.204230:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574633.204265:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346866048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574633.204342:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574633.205361:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346866048 00000100:00100000:2.0:1787574633.205374:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346866048 00000100:00100000:2.0:1787574633.205434:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787574633.205444:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346866048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574633.205477:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787574633.205539:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346866048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574633.205546:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787574633.205591:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346866048:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1787574633.724719:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787574633.843892:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574634.038966:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787574634.097408:0:17139:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574634.097419:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca4033ba000 from 13 10000000:01000000:0.0:1787574634.097425:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574634.097486:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574634.097512:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574634.097541:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574634.097574:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574634.097667:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574634.097782:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574634.098017:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346866176 00000100:00100000:3.0:1787574634.098028:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346866176 00000100:00100000:3.0:1787574634.098145:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787574634.098157:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+16:17139:x1874407346866176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574634.098173:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574634.098192:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb91ea expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574634.098221:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb91ea expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574634.098234:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb91ea expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574634.098269:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa400, rc 0) 00000100:00100000:3.0:1787574634.098317:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17139:x1874407346866176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574634.098339:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787574634.098621:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574634.098641:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574634.098662:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574634.098746:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574634.098891:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574634.098963:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518b42e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574634.099001:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346866304 00000100:00100000:0.0:1787574634.099006:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346866304 00000100:00100000:0.0:1787574634.099072:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787574634.099080:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17139:x1874407346866304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574634.099221:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17139:x1874407346866304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574634.099228:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787574634.099418:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574634.099457:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574634.099563:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574634.099584:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518b42e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574634.099599:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346866432 00000100:00100000:3.0:1787574634.099603:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346866432 00000100:00100000:3.0:1787574634.099625:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574634.099632:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17139:x1874407346866432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574634.099721:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17139:x1874407346866432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574634.099728:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574634.099900:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787574634.101149:0:18327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787574634.101713:0:17139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787574634.101745:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574634.101866:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574634.101882:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574634.101895:0:17139:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574634.101897:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53f52b800 from 13 10000000:01000000:0.0:1787574634.101900:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574634.101939:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574634.101947:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574634.101967:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574634.101991:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574634.102053:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574634.102890:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574634.105973:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346866560 00000100:00100000:3.0:1787574634.105991:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346866560 00000100:00100000:3.0:1787574634.106066:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574634.106080:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+17:17139:x1874407346866560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574634.106104:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574634.106154:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb91ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb91f8 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574634.106188:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb91ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb91f8 expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574634.106200:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb91ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb91f8 expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574634.106212:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa000, rc 0) 00000100:00100000:3.0:1787574634.106476:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17139:x1874407346866560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 398us (4421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574634.106484:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574634.106624:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574634.106647:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574634.106659:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574634.106755:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574634.106932:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574634.107014:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518b42e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574634.107619:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346866688 00000100:00100000:0.0:1787574634.107626:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346866688 00000100:00100000:0.0:1787574634.107703:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787574634.107713:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17139:x1874407346866688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574634.107904:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17139:x1874407346866688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574634.107911:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787574634.109032:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574634.109099:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574634.109165:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574634.109258:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574634.110214:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346866816 00000100:00100000:3.0:1787574634.110225:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346866816 00000100:00100000:3.0:1787574634.110511:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787574634.110523:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17139:x1874407346866816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574634.110711:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:17139:x1874407346866816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574634.110728:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787574634.111990:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346866816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787574634.113338:0:18328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787574634.113588:0:17139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787574634.113618:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574634.113632:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574634.113646:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574634.866132:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574635.889691:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574636.913728:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787574637.299405:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574637.299412:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574637.299415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574637.299418:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574637.299449:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574637.299451:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574637.299454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574637.299457:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574637.299476:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346867328:0@lo:400:kworker.0 00000100:00100000:2.0:1787574637.299502:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346867200:0@lo:400:kworker.0 00000100:00100000:3.0:1787574637.299555:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346866944:0@lo:400:kworker.0 00000100:00100000:0.0:1787574637.299562:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346867072:0@lo:400:kworker.0 00000100:00100000:1.0:1787574637.299619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574637.299647:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346867328 00000100:00100000:0.0:1787574637.299655:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346867328 00000100:00100000:0.0:1787574637.299700:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787574637.299714:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346867328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574637.299782:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346867328:12345-0@lo:400:kworker.0 Request processed in 74us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574637.299799:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787574637.299857:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346867328:0@lo:400:kworker.0 00000100:00100000:0.0:1787574637.299878:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574637.299915:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346867072 00000100:00100000:0.0:1787574637.299919:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346867072 00000100:00100000:0.0:1787574637.299939:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787574637.299945:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346867072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574637.299979:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346867072:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574637.299985:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787574637.300010:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346867072:0@lo:400:kworker.0 00000100:00100000:2.0:1787574637.309003:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574637.309199:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346867200 00000100:00100000:0.0:1787574637.309224:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346867200 00000100:00100000:0.0:1787574637.309293:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574637.309304:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346867200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574637.309403:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346867200:12345-0@lo:400:kworker.0 Request processed in 101us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574637.309411:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787574637.309456:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca404299880 x1874407346867200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574637.309968:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346867200:0@lo:400:kworker.0 00000100:00100000:3.0:1787574637.313633:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574637.313685:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346867456:0@lo:400:kworker.0 00000100:00100000:0.0:1787574637.313896:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346866944 00000100:00100000:0.0:1787574637.313905:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346866944 00000100:00100000:0.0:1787574637.313965:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787574637.313975:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:3634:x1874407346866944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574637.314046:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:3634:x1874407346866944:12345-0@lo:400:kworker.0 Request processed in 74us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574637.314053:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787574637.314077:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574637.314106:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346867456 00000100:00100000:0.0:1787574637.314110:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346867456 00000100:00100000:3.0:1787574637.314115:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346866944:0@lo:400:kworker.0 00000100:00100000:0.0:1787574637.314136:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574637.314142:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346867456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574637.314195:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346867456:12345-0@lo:400:kworker.0 Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574637.314202:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787574637.317999:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca40429bb80 x1874407346867456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574637.318021:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346867456:0@lo:400:kworker.0 00010000:00010000:1.0:1787574637.949504:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787574638.259547:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574638.323156:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574638.323179:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346867584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574638.323272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574638.323568:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346867584 00000100:00100000:0.0:1787574638.323578:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346867584 00000100:00100000:0.0:1787574638.323625:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574638.323633:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346867584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574638.323671:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787574638.323740:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346867584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574638.323748:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574638.323769:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574638.323778:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346867712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574638.323804:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574638.323845:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346867712 00000100:00100000:0.0:1787574638.323849:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346867712 00000100:00100000:0.0:1787574638.323871:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574638.323877:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346867712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574638.323913:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787574638.323955:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346867712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574638.323961:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574638.324002:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346867712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574638.324034:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346867584:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787574638.972128:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574639.986433:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574641.017311:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787574641.612122:0:18645:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787574641.612126:0:18645:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787574641.612127:0:18645:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787574641.612273:0:18645:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ca53be15800 00000020:01000004:2.0:1787574641.612289:0:18645:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787574641.612301:0:18645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787574641.612313:0:18645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ca52e6f3370) 00000020:00000080:2.0:1787574641.612328:0:18645:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787574641.714054:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787574641.717542:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787574641.719220:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787574641.725538:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787574641.726512:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787574641.727854:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787574641.728806:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1787574641.732097:0:18645:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787574641.732357:0:18645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787574641.732371:0:18645:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787574641.732383:0:18645:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd18a1efeeddb920d 00000020:01000004:3.0:1787574641.732390:0:18645:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787574641.732412:0:18645:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787574641.732415:0:18645:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787574641.732421:0:18645:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787574641.732426:0:18645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787574641.732438:0:18645:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ca52f3319b8) 00000020:00000080:3.0:1787574641.732448:0:18645:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787574641.738394:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574641.738588:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787574641.738594:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787574641.742642:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787574641.742653:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787574641.743009:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787574641.743016:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787574641.744624:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574641.746907:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787574641.746923:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787574641.749717:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787574641.749729:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787574641.780871:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574641.781163:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787574641.781170:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787574641.784190:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787574641.784208:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787574641.786580:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787574641.786593:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787574641.803069:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787574641.803305:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787574641.803312:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787574641.808544:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787574641.808666:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787574641.864188:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787574641.866431:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787574641.866441:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787574641.868052:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787574641.868073:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787574641.868638:0:18645:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787574641.868670:0:18645:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787574641.868677:0:18645:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787574641.889814:0:18645:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787574641.889868:0:18645:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787574641.889873:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787574641.889875:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787574641.889876:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574641.889877:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574641.889879:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574641.889880:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574641.889882:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574641.889884:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574641.889886:0:18645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787574641.889890:0:18645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787574641.889893:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787574641.889894:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787574641.889896:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574641.889897:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574641.889898:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574641.889899:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574641.889900:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574641.889901:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574641.889902:0:18645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787574641.889932:0:18645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787574641.889953:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346867840:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787574641.890023:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574641.890117:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5078b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574641.897180:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346867840 00000100:00100000:0.0:1787574641.897197:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346867840 00000100:00100000:0.0:1787574641.897291:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787574641.897302:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:18645:x1874407346867840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787574641.897342:0:17136:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787574641.897346:0:17136:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787574641.897350:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787574641.898054:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:18645:x1874407346867840:12345-0@lo:253:mount.lustre.0 Request processed in 749us (8026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574641.898063:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787574641.898166:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346867840:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787574641.898198:0:18645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787574641.898202:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787574641.898204:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787574641.898205:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574641.898207:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574641.898208:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574641.898210:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574641.898211:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574641.898213:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574641.898214:0:18645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787574641.898268:0:18645:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca53be15800 from lustre-OST0000 10000000:01000000:3.0:1787574641.898298:0:18645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787574641.898301:0:18645:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787574641.898309:0:18645:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ca4024c99b8 local copy 00010000:00010000:3.0:1787574641.898320:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574641.898423:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346867968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574641.898459:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574641.898491:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574641.898572:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346867968 00000100:00100000:2.0:1787574641.898578:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346867968 00000100:00100000:2.0:1787574641.898632:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787574641.898641:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:18645:x1874407346867968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574641.898724:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:18645:x1874407346867968:12345-0@lo:501:mount.lustre.0 Request processed in 85us (264us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574641.898732:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787574641.898873:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346867968:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787574641.898888:0:18645:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787574641.898907:0:18645:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787574641.898913:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574641.898922:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574641.898945:0:18645:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca53be15800 10000000:01000000:1.0:1787574641.898949:0:18645:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787574641.898954:0:18645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787574641.898956:0:18645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787574641.898961:0:18645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787574641.898964:0:18645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787574641.898986:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574641.898994:0:18645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574641.899003:0:18645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574641.899016:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574641.899044:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574641.899064:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509b72d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574641.899133:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346868096 00000100:00100000:0.0:1787574641.899138:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346868096 00000100:00100000:0.0:1787574641.899169:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787574641.899175:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+18:18645:x1874407346868096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574641.899184:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574641.899198:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb9222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb921b expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574641.899222:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb9222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb921b expref: 19 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574641.899266:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb9222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb921b expref: 19 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574641.899275:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c600, rc 0) 00000100:00100000:0.0:1787574641.899314:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:18645:x1874407346868096:12345-0@lo:101:mount.lustre.0 Request processed in 139us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574641.899321:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787574641.899449:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574641.899468:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574641.899478:0:18645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574641.900624:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787574641.901215:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574641.910542:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787574641.910601:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787574641.910633:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787574641.910648:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787574641.910660:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787574641.910672:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787574641.911569:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787574641.911586:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787574641.911721:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574641.913559:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574641.913608:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5068a0600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574641.913709:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346868224 00000100:00100000:0.0:1787574641.913718:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346868224 00000100:00100000:0.0:1787574641.913771:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787574641.913789:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:18645:x1874407346868224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574641.913951:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:18645:x1874407346868224:12345-0@lo:501:mount.lustre.0 Request processed in 171us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574641.913959:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787574641.914145:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574641.914188:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574641.914283:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574641.914304:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5068a0600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574641.915565:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346868352 00000100:00100000:0.0:1787574641.915576:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346868352 00000100:00100000:0.0:1787574641.915632:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787574641.915641:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:18645:x1874407346868352:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574641.916684:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:18645:x1874407346868352:12345-0@lo:503:mount.lustre.0 Request processed in 1036us (2439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574641.916707:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787574641.918451:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868352:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787574641.919025:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787574641.919103:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574641.919173:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574641.919503:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574641.919822:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346868480 00000100:00100000:3.0:1787574641.919829:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346868480 00000100:00100000:3.0:1787574641.919885:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787574641.919896:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:18645:x1874407346868480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574641.920409:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:18645:x1874407346868480:12345-0@lo:502:mount.lustre.0 Request processed in 513us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574641.920418:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787574641.920595:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574641.920802:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787574641.920828:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787574641.920841:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787574641.920853:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787574641.920865:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787574641.920877:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787574641.920889:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787574641.920900:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787574641.920913:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787574641.920941:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787574641.920955:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787574641.920966:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787574641.920996:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574641.921036:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574641.921059:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574641.921172:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346868608 00000100:00100000:0.0:1787574641.921177:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346868608 00000100:00100000:0.0:1787574641.921216:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787574641.921224:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:18645:x1874407346868608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574641.921346:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:18645:x1874407346868608:12345-0@lo:502:mount.lustre.0 Request processed in 122us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574641.921358:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787574641.924986:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574641.925095:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787574641.925110:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787574641.926607:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787574641.926616:0:18662:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787574641.926622:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574641.926624:0:18662:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787574641.926630:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787574641.926645:0:18662:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ca5350bcd28) 00000020:00000080:0.0:1787574641.926670:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787574641.926675:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787574641.926771:0:18662:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53be15800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787574641.926789:0:18662:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787574641.926797:0:18662:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd18a1efeeddb9230 00010000:00010000:0.0:1787574641.937468:0:18662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1787574641.938104:0:18662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1787574641.939953:0:18662:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1787574641.947527:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787574641.947540:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574641.947548:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574641.947550:0:18662:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787574641.947560:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787574641.947563:0:18662:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1787574641.947565:0:18662:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787574641.947566:0:18662:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787574641.947568:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787574641.947570:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574641.947572:0:18662:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787574641.947575:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574641.947578:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574641.947579:0:18662:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787574641.947582:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787574641.947584:0:18662:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787574641.947586:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574641.947588:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574641.947589:0:18662:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787574641.947591:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574641.947593:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574641.947595:0:18662:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787574641.947598:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787574641.947629:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574641.947632:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574641.947633:0:18662:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787574641.947636:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787574641.965645:0:18645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787574641.965708:0:18645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787574641.965733:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574641.965745:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574641.965755:0:18645:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53be15800 from 1 10000000:01000000:1.0:1787574641.965787:0:18645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574641.965827:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574641.965835:0:18645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574641.965847:0:18645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574641.965872:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574641.965941:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574641.965983:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574641.966146:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346868736 00000100:00100000:3.0:1787574641.966154:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346868736 00000100:00100000:3.0:1787574641.966212:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787574641.966221:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:18645:x1874407346868736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574641.966234:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574641.966265:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fb800/0xd18a1efeeddb923e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9237 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574641.966289:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fb800/0xd18a1efeeddb923e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9237 expref: 20 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574641.966312:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fb800/0xd18a1efeeddb923e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9237 expref: 20 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574641.966321:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb800, rc 0) 00000100:00100000:3.0:1787574641.966361:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:18645:x1874407346868736:12345-0@lo:101:mount.lustre.0 Request processed in 141us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574641.966369:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787574641.968933:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574641.968960:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574641.968971:0:18645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574641.972865:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787574641.973183:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574641.973421:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787574641.973444:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787574641.973459:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787574641.973463:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787574641.973533:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574641.973594:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574641.973643:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574641.973653:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346868864 00000100:00100000:3.0:1787574641.973660:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346868864 00000100:00100000:3.0:1787574641.973711:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787574641.973721:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:18645:x1874407346868864:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574641.973866:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:18645:x1874407346868864:12345-0@lo:501:mount.lustre.0 Request processed in 146us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574641.973873:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574641.974421:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574641.974474:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574641.974514:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574641.974540:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574641.974637:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346868992 00000100:00100000:2.0:1787574641.974643:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346868992 00000100:00100000:2.0:1787574641.974674:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787574641.974681:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:18645:x1874407346868992:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574641.974766:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:18645:x1874407346868992:12345-0@lo:503:mount.lustre.0 Request processed in 84us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574641.974773:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787574641.978863:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346868992:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787574641.979320:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787574641.979404:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574641.979494:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574641.979534:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574641.981836:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346869120 00000100:00100000:0.0:1787574641.981849:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346869120 00000100:00100000:0.0:1787574641.981909:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787574641.981918:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:18645:x1874407346869120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574641.982069:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:18645:x1874407346869120:12345-0@lo:502:mount.lustre.0 Request processed in 151us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574641.982077:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787574641.982253:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574641.982515:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787574641.982547:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787574641.982564:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787574641.982596:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787574641.982611:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787574641.982623:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787574641.982634:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787574641.982644:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787574641.982655:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787574641.982667:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787574641.982680:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787574641.982714:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574641.982761:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574641.982816:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574641.982900:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346869248 00000100:00100000:0.0:1787574641.982906:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346869248 00000100:00100000:0.0:1787574641.982946:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787574641.982954:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:18645:x1874407346869248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574641.983040:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:18645:x1874407346869248:12345-0@lo:502:mount.lustre.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574641.983058:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787574641.983182:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574641.983221:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787574641.983230:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787574641.983912:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574641.983925:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574641.983928:0:18666:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787574641.983933:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca53be15800 00000020:00000080:1.0:1787574641.983936:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574641.983943:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574641.983945:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574641.983946:0:18666:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787574641.983948:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574641.983950:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574641.983951:0:18666:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787574641.983954:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca53be15800 00000020:00000080:1.0:1787574641.983956:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574641.984019:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574641.984023:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574641.984025:0:18666:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787574641.984027:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574641.984030:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574641.984032:0:18666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574641.984035:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca53be15800 00000020:00000080:1.0:1787574641.984037:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574641.984053:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574641.984056:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574641.984058:0:18666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574641.984060:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574641.984063:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574641.984064:0:18666:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787574641.984067:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca53be15800 00000020:00000080:1.0:1787574641.984070:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574641.984087:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574641.984090:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574641.984092:0:18666:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787574641.984094:0:18666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787574641.999550:0:18645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787574641.999598:0:18645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787574641.999614:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574641.999627:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574641.999765:0:18645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787574641.999768:0:18645:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca53be15800 10000000:01000000:2.0:1787574641.999771:0:18645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca53be15800 10000000:01000000:2.0:1787574641.999792:0:18645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787574641.999800:0:18645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca53be15800 from 1 10000000:01000000:2.0:1787574641.999803:0:18645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787574641.999839:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574641.999848:0:18645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574641.999866:0:18645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574641.999890:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574641.999953:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574642.000000:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50780a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787574642.007450:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346869376 00000100:00100000:0.0:1787574642.007466:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346869376 00000100:00100000:0.0:1787574642.007521:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787574642.007532:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:18645:x1874407346869376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574642.007549:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574642.007568:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409c000/0xd18a1efeeddb924c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9245 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574642.007596:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409c000/0xd18a1efeeddb924c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9245 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574642.007609:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409c000/0xd18a1efeeddb924c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9245 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574642.007618:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c000, rc 0) 00000100:00100000:0.0:1787574642.007706:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346869376:12345-0@lo:101:mount.lustre.0 Request processed in 176us (7753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574642.007712:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787574642.007718:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574642.007735:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.007744:0:18645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574642.025568:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787574642.025899:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574642.026131:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787574642.026157:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787574642.026172:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787574642.028445:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787574642.028485:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787574642.028500:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787574642.028513:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787574642.028526:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787574642.028555:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787574642.028568:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787574642.028580:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787574642.028594:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787574642.028623:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787574642.028638:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787574642.028651:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787574642.028663:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787574642.028676:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787574642.028689:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787574642.028702:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787574642.028717:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787574642.028732:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787574642.028746:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787574642.028759:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787574642.028772:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787574642.028805:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787574642.028820:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787574642.028833:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787574642.028845:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787574642.028873:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787574642.028889:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787574642.028901:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787574642.028913:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787574642.028927:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787574642.028940:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787574642.028953:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787574642.028965:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787574642.028978:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787574642.029003:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787574642.029008:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787574642.029120:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574642.029193:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574642.029258:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50b7a89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574642.029292:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346869504 00000100:00100000:3.0:1787574642.029300:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346869504 00000100:00100000:3.0:1787574642.029350:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787574642.029360:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346869504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574642.029487:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346869504:12345-0@lo:501:mount.lustre.0 Request processed in 127us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574642.029495:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:2.0:1787574642.034452:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574642.034614:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574642.034672:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574642.034750:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574642.036280:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50b7a89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574642.039903:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346869632 00000100:00100000:3.0:1787574642.039917:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346869632 00000100:00100000:3.0:1787574642.040078:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787574642.040090:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346869632:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574642.040284:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346869632:12345-0@lo:503:mount.lustre.0 Request processed in 195us (5532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574642.040295:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787574642.040700:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869632:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787574642.041137:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787574642.041215:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574642.041305:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574642.041331:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346869760 00000100:00100000:0.0:1787574642.041337:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346869760 00000100:00100000:2.0:1787574642.041342:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50780a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787574642.041370:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787574642.041379:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346869760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574642.041479:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346869760:12345-0@lo:502:mount.lustre.0 Request processed in 101us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574642.041486:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787574642.041558:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574642.041855:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787574642.041883:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787574642.041899:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787574642.041914:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787574642.041929:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787574642.041944:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787574642.041980:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787574642.041998:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787574642.042013:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787574642.042028:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787574642.042043:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787574642.042056:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787574642.042069:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787574642.042083:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787574642.042103:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787574642.042117:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787574642.042131:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787574642.042147:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787574642.042160:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787574642.042173:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787574642.042186:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787574642.042199:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787574642.042226:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787574642.042364:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787574642.042384:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787574642.042398:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787574642.042413:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787574642.042427:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787574642.042441:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787574642.042454:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787574642.042467:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787574642.042480:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787574642.042495:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787574642.042509:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787574642.042522:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787574642.042536:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787574642.042550:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787574642.042564:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787574642.042592:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787574642.042613:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787574642.042626:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787574642.042640:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787574642.042653:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787574642.042666:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787574642.042681:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787574642.045470:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787574642.045517:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787574642.045531:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787574642.045587:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869888:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574642.045667:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574642.045715:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50780a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574642.045837:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346869888 00000100:00100000:3.0:1787574642.045845:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346869888 00000100:00100000:3.0:1787574642.045897:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787574642.045906:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346869888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574642.046018:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346869888:12345-0@lo:502:mount.lustre.0 Request processed in 112us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574642.046027:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787574642.046135:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346869888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574642.046338:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787574642.046361:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787574642.046381:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346870016:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574642.046413:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574642.046436:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50780a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574642.046577:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346870016 00000100:00100000:3.0:1787574642.046582:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346870016 00000100:00100000:3.0:1787574642.046611:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787574642.046617:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346870016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574642.046702:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346870016:12345-0@lo:502:mount.lustre.0 Request processed in 85us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574642.046709:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787574642.046865:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346870016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574642.046912:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1787574642.046920:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787574642.047540:0:18672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787574642.047554:0:18672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ca52e6f0000) 00000020:00000080:2.0:1787574642.047576:0:18672:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787574642.047655:0:18672:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53be15800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787574642.047659:0:18672:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53be15800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787574642.047661:0:18672:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53be15800 3 00010000:00080000:2.0:1787574642.047689:0:18672:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca5109bb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1787574642.051683:0:18672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787574642.055155:0:18672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787574642.055204:0:18672:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787574642.055215:0:18672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd18a1efeeddb925a 00000100:00080000:0.0:1787574642.055225:0:18672:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787574642.055230:0:18672:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ca5109bb000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574642.055279:0:18672:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca40423b100 x1874407346870144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574642.055301:0:18672:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787574642.055818:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346870144:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787574642.055890:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1787574642.056083:0:18672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787574642.056096:0:18672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ca52f334d28) 00000020:00000080:3.0:1787574642.056111:0:18672:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1787574642.056201:0:18672:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53be15800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787574642.056204:0:18672:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53be15800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787574642.056207:0:18672:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53be15800 3 00010000:00080000:3.0:1787574642.056253:0:18672:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca4023fc800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.140@tcp at head 00000100:00100000:0.0:1787574642.056820:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346870144 00000100:00100000:0.0:1787574642.056829:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346870144 00000100:00100000:0.0:1787574642.056861:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574642.056868:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874407346870144:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787574642.056890:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:0.0:1787574642.056926:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd18a1efeeddb9268 00000004:00100000:0.0:1787574642.056943:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574642.056971:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574642.057039:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874407346870144:12345-0@lo:38:llog_process_th.0 Request processed in 169us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574642.057046:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787574642.057088:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca40423b100 x1874407346870144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574642.057098:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787574642.057106:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787574642.057113:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787574642.057116:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787574642.057118:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5109bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787574642.057123:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346870144:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787574642.057535:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574642.057540:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574642.057543:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574642.057550:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574642.057574:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574642.057577:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574642.057580:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574642.057583:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787574642.057608:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346870400:0@lo:400:kworker.0 00000100:00100000:2.0:1787574642.057641:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574642.057664:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574642.057668:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346870528:0@lo:400:kworker.0 00000100:00100000:2.0:1787574642.057688:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574642.057733:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346870400 00000100:00100000:2.0:1787574642.057737:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346870400 00000100:00100000:2.0:1787574642.057764:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574642.057770:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346870400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574642.057814:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346870400:12345-0@lo:400:kworker.0 Request processed in 44us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574642.057820:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574642.057840:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346870528 00000100:00100000:2.0:1787574642.057843:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346870528 00000100:00100000:2.0:1787574642.057862:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574642.057867:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346870528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574642.057892:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346870528:12345-0@lo:400:kworker.0 Request processed in 26us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574642.057898:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574642.057936:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346870528:0@lo:400:kworker.0 00010000:00080000:2.0:1787574642.057952:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca40429b100 x1874407346870400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574642.057962:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346870400:0@lo:400:kworker.0 00000100:00100000:1.0:1787574642.058821:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346870272:0@lo:400:kworker.0 00000100:00100000:1.0:1787574642.058862:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574642.058896:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574642.058902:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346870656:0@lo:400:kworker.0 00000100:00100000:1.0:1787574642.058924:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574642.058964:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346870656 00000100:00100000:1.0:1787574642.058969:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346870656 00000100:00100000:1.0:1787574642.058997:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574642.059003:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346870656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574642.059044:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346870656:12345-0@lo:400:kworker.0 Request processed in 40us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574642.059050:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787574642.059079:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca40429b480 x1874407346870656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574642.059090:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346870656:0@lo:400:kworker.0 00000100:00100000:2.0:1787574642.060904:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346870272 00000100:00100000:2.0:1787574642.060919:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346870272 00000100:00100000:2.0:1787574642.060974:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787574642.060984:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346870272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574642.062546:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346870272:12345-0@lo:400:kworker.0 Request processed in 1556us (3675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574642.062558:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787574642.063282:0:18672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000100:00100000:1.0:1787574642.065375:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346870272:0@lo:400:kworker.0 00000020:00000080:3.0:1787574642.070051:0:18672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787574642.070101:0:18672:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787574642.070117:0:18672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd18a1efeeddb926f 00000100:00080000:3.0:1787574642.070130:0:18672:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574642.070136:0:18672:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9ca4023fc800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574642.070175:0:18672:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404055180 x1874407346870784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574642.070223:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1874407346870784:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787574642.070336:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574642.070400:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346870784 00000100:00100000:3.0:1787574642.070407:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346870784 00000100:00100000:3.0:1787574642.070439:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574642.070447:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874407346870784:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787574642.070471:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:3.0:1787574642.070514:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd18a1efeeddb9276 00000004:00100000:3.0:1787574642.070529:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787574642.070557:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9ca4023f8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574642.070605:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874407346870784:12345-0@lo:38:llog_process_th.0 Request processed in 156us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574642.070612:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787574642.070647:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca404055180 x1874407346870784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574642.070657:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574642.070664:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787574642.070670:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787574642.070674:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787574642.070684:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4023fc800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787574642.070689:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1874407346870784:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787574642.071352:0:18672:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787574642.071475:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574642.071480:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574642.071482:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574642.071485:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574642.071489:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574642.071491:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574642.071493:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574642.071496:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787574642.071638:0:18672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787574642.071809:0:18645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787574642.071838:0:18645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574642.071862:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.071885:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787574642.071933:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787574642.071935:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787574642.071937:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574642.071938:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574642.071939:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574642.071940:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574642.071941:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574642.071943:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574642.071944:0:18645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574642.071948:0:18645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787574642.071950:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574642.071952:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787574642.071953:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574642.071954:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574642.071955:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574642.071956:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574642.071957:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574642.071958:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574642.071959:0:18645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574642.071981:0:18645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787574642.071998:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346870912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787574642.072051:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574642.072088:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50780a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574642.072289:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346870912 00000100:00100000:1.0:1787574642.072295:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346870912 00000100:00100000:1.0:1787574642.072349:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787574642.072358:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:18645:x1874407346870912:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787574642.072381:0:17135:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787574642.072394:0:17135:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787574642.077346:0:17135:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787574642.077361:0:17135:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787574642.077431:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787574642.077436:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787574642.077460:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.077479:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb91c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb91c0 expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.077486:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb91d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb91ce expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.077494:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.077532:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb91d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb91ce expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.077545:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb91d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb91ce expref: 21 pid: 17136 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574642.077558:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346871040:0@lo:104: 00000100:00100000:3.0:1787574642.077620:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787574642.077667:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb91c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb91c0 expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.077686:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb91c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb91c0 expref: 21 pid: 17136 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574642.077702:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346871168:0@lo:104: 00000100:00100000:3.0:1787574642.077727:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574642.077745:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5062d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787574642.077770:0:17126:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787574642.077801:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346871040 00000100:00100000:3.0:1787574642.077808:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346871040 00000100:00100000:3.0:1787574642.077840:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346871168 00000100:00100000:3.0:1787574642.077843:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346871168 00000100:00100000:3.0:1787574642.077856:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574642.077865:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+4:17159:x1874407346871040:12345-0@lo:104: 00010000:00010000:3.0:1787574642.077878:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.077929:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574642.077934:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+4:17159:x1874407346871040:12345-0@lo:104: Request processed in 70us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574642.077941:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574642.077956:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574642.077961:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52678ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:17159:x1874407346871168:12345-0@lo:104: 00010000:00010000:3.0:1787574642.077968:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.077999:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787574642.078004:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52678ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:17159:x1874407346871168:12345-0@lo:104: Request processed in 43us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574642.078015:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787574642.078054:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574642.078060:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078068:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574642.078072:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078081:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574642.078088:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574642.078094:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574642.078120:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078126:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574642.078151:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078158:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca509e19000/0xd18a1efeeddb91ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91d5 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078170:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574642.078173:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078187:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574642.078190:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078196:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574642.078203:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574642.078208:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574642.078222:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078228:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574642.078272:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078279:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca509e19400/0xd18a1efeeddb91c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91c7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078292:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574642.078294:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574642.078296:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574642.078303:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574642.078314:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346871424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574642.078341:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574642.078382:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346871424 00000100:00100000:3.0:1787574642.078386:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346871424 00010000:00010000:3.0:1787574642.078416:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb91c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb91c0 expref: 22 pid: 17136 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574642.078437:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574642.078443:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:3634:x1874407346871424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574642.078452:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574642.078456:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb91c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb91c0 expref: 22 pid: 17136 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078465:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb91c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb91c0 expref: 22 pid: 17136 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.078478:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574642.078504:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:3634:x1874407346871424:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574642.078510:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574642.078559:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346871424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574642.078588:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346871040:0@lo:104: 00010000:00010000:3.0:1787574642.078596:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb91c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb91c0 expref: 21 pid: 17136 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574642.078606:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346871168:0@lo:104: 00010000:00010000:3.0:1787574642.078623:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574642.078813:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346871296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574642.078853:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574642.079938:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346871296 00000100:00100000:2.0:1787574642.079948:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346871296 00010000:00010000:2.0:1787574642.079986:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb91d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb91ce expref: 21 pid: 17136 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574642.080021:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574642.080030:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53c0d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:3637:x1874407346871296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574642.080049:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574642.080055:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb91d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb91ce expref: 21 pid: 17136 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.080067:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb91d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb91ce expref: 21 pid: 17136 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.080083:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb91d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb91ce expref: 21 pid: 17136 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.080099:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.080107:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787574642.080122:0:17129:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010946088s 00010000:00010000:2.0:1787574642.080126:0:17129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.080132:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.080139:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.080145:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.080151:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574642.080155:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.080167:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.080179:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574642.080190:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574642.080259:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53c0d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:3637:x1874407346871296:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574642.080267:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574642.080631:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346871296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574642.081027:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.081037:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574642.081050:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb927d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574642.081330:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:18645:x1874407346870912:12345-0@lo:253:mount.lustre.0 Request processed in 8970us (9276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574642.081339:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787574642.082841:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:18645:1874407346870912:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574642.082861:0:18645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787574642.082864:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574642.082865:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787574642.082867:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574642.082868:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574642.082869:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574642.082870:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574642.082871:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574642.082873:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574642.082874:0:18645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787574642.082888:0:18645:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1787574642.090046:0:18645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787574642.096719:0:18645:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787574642.096728:0:18645:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787574642.096765:0:18645:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787574642.096813:0:18645:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787574642.096831:0:18645:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787574642.096851:0:18645:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787574642.098375:0:18645:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574642.100578:0:18645:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574643.058353:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787574643.141833:0:18725:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574643.142063:0:18725:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787574643.441569:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346871552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574643.441652:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574643.441787:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346871680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574643.441818:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574643.445484:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346871552 00000100:00100000:2.0:1787574643.445499:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346871552 00000100:00100000:2.0:1787574643.448835:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346871680 00000100:00100000:2.0:1787574643.448852:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346871680 00000100:00100000:1.0:1787574643.452482:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574643.452505:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346871552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787574643.452548:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787574643.452690:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346871552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 194us (11037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574643.452697:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574643.452722:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787574643.452730:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346871680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574643.452748:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787574643.452793:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346871680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (10974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574643.452799:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787574643.452841:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346871680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574643.453999:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346871552:0@lo:41:osp-pre-0-1.0 10000000:01000000:1.0:1787574643.828657:0:17139:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574643.828663:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca4033ba000 from 9 10000000:01000000:1.0:1787574643.828669:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574643.828721:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574643.828733:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574643.828744:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574643.828780:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346871808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574643.828850:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574643.828903:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574643.828938:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346871808 00000100:00100000:3.0:1787574643.828947:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346871808 00000100:00100000:3.0:1787574643.829005:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787574643.829015:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:17139:x1874407346871808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574643.829028:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574643.829043:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb928b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9284 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574643.829067:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb928b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9284 expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574643.829077:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb928b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9284 expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574643.829087:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb400, rc 0) 00000100:00100000:3.0:1787574643.829125:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:17139:x1874407346871808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574643.829136:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787574643.829676:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346871808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574643.829696:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574643.829707:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574643.829772:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346871936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787574643.829812:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574643.829843:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574643.829957:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346871936 00000100:00100000:3.0:1787574643.829963:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346871936 00000100:00100000:3.0:1787574643.830041:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787574643.830049:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:17139:x1874407346871936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787574643.830063:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787574643.830079:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787574643.830082:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787574643.830157:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:17139:x1874407346871936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574643.830163:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787574643.830669:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346871936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787574643.830735:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787574643.830744:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574643.830753:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574643.830779:0:17139:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574643.830782:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca53f52b800 from 9 10000000:01000000:1.0:1787574643.830784:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574643.830808:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574643.830816:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574643.830824:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574643.830840:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346872064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574643.831371:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574643.831437:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787574643.837474:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346872064 00000100:00100000:0.0:1787574643.837491:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346872064 00000100:00100000:0.0:1787574643.837675:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787574643.837687:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:17139:x1874407346872064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574643.837705:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574643.837724:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409d200/0xd18a1efeeddb9299 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9292 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574643.837754:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409d200/0xd18a1efeeddb9299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9292 expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574643.837797:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409d200/0xd18a1efeeddb9299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9292 expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574643.837806:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d200, rc 0) 00000100:00100000:0.0:1787574643.837932:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:17139:x1874407346872064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (6560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574643.837943:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787574643.840063:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346872064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574643.840090:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574643.840104:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574643.840178:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346872192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787574643.840378:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574643.840423:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574643.840492:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346872192 00000100:00100000:1.0:1787574643.840500:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346872192 00000100:00100000:1.0:1787574643.840646:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787574643.840656:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:17139:x1874407346872192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787574643.840677:0:17137:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787574643.840694:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787574643.840697:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787574643.840799:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:17139:x1874407346872192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574643.840807:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787574643.840874:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346872192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787574643.840933:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787574643.840942:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574643.840961:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574644.090157:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574644.341389:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787574645.105346:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574646.129651:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574647.155291:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574647.217338:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574632/real 1787574632] req@ffff9ca53be5df80 x1874407346865024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574647 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574647.217371:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca53be5df80 x1874407346865024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574647 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574647.217382:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574632/real 1787574632] req@ffff9ca404054e00 x1874407346865152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574647 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574647.217391:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca404054e00 x1874407346865152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574647 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787574647.217409:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca536be9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574647.217430:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787574647.217435:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346865024:0@lo:8:kworker.0 00000100:00080000:0.0:1787574647.217441:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574647.217447:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787574647.217450:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346865152:0@lo:8:kworker.0 00000100:00080000:2.0:1787574647.217612:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574647.217617:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574647.217627:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574647.217630:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574647.217651:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574647.217654:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787574647.217656:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca536be9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574647.217661:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 571 00000100:00080000:2.0:1787574647.217666:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787574647.217672:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ca536be9800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574647.217692:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404298a80 x1874407346872832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574647.217704:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574647.217707:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787574647.217708:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574647.217711:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 571 00000100:00080000:2.0:1787574647.217713:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787574647.217716:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca4033de800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574647.217726:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404298e00 x1874407346872960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574647.217815:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346872704:0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.217896:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574647.217935:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787574647.217941:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346872320:0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.217970:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574647.218000:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346873088:0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.218024:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574647.218050:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346872576:0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.218073:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574647.218090:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346873344:0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.218114:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574647.218130:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787574647.218136:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346872448:0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.218157:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574647.218173:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346873216:0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.218193:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574647.218216:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346872320 00000100:00100000:0.0:1787574647.218225:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346872320 00000100:00100000:0.0:1787574647.218297:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787574647.218307:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:3636:x1874407346872320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.218353:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:3636:x1874407346872320:12345-0@lo:400:kworker.0 Request processed in 48us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574647.218360:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787574647.218392:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346873088 00000100:00100000:0.0:1787574647.218396:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346873088 00000100:00100000:0.0:1787574647.218414:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346872576 00000100:00100000:0.0:1787574647.218417:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346872576 00000100:00100000:0.0:1787574647.218439:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346873344 00000100:00100000:0.0:1787574647.218442:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346873344 00000100:00100000:0.0:1787574647.218464:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346873216 00000100:00100000:0.0:1787574647.218467:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346873216 00000100:00100000:0.0:1787574647.218481:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787574647.218485:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346873088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.218518:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346873088:12345-0@lo:400:kworker.0 Request processed in 32us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574647.218524:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787574647.218536:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787574647.218542:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346872576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.218572:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346872576:12345-0@lo:400:kworker.0 Request processed in 31us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574647.218579:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787574647.218589:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574647.218595:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346873344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.218621:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346873344:12345-0@lo:400:kworker.0 Request processed in 27us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574647.218627:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574647.218638:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787574647.218644:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346873216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.218669:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346873216:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574647.218675:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787574647.218728:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574647.218744:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787574647.218771:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4040bd500 x1874407346873216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574647.218791:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346873216:0@lo:400:kworker.0 00010000:00080000:0.0:1787574647.218807:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca40429b800 x1874407346872576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574647.218815:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346872576:0@lo:400:kworker.0 00010000:00080000:0.0:1787574647.218824:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4040bea00 x1874407346873344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574647.218832:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346873344:0@lo:400:kworker.0 00000100:00100000:0.0:1787574647.218856:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346872832:0@lo:8:kworker.0 00000100:00100000:0.0:1787574647.218887:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574647.218904:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346872960:0@lo:8:kworker.0 00000100:00100000:0.0:1787574647.218926:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574647.218959:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346872832 00000100:00100000:0.0:1787574647.218963:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346872832 00000100:00100000:0.0:1787574647.218978:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346872960 00000100:00100000:0.0:1787574647.218980:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346872960 00000100:00100000:0.0:1787574647.218990:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574647.218995:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1874407346872832:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787574647.219022:0:18650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:0.0:1787574647.219051:0:18650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb92a0 00002000:00100000:0.0:1787574647.219065:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ca5350a1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787574647.219069:0:18650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787574647.219072:0:18650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787574647.219279:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787574647.219309:0:18650:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574647.219352:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1874407346872832:12345-0@lo:8:kworker.0 Request processed in 356us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574647.219359:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574647.219377:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574647.219381:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1874407346872960:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787574647.219392:0:18650:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787574647.220188:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346872704 00000100:00100000:2.0:1787574647.220197:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346872704 00000100:00100000:2.0:1787574647.220251:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346872448 00000100:00100000:2.0:1787574647.220254:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346872448 00000100:00100000:2.0:1787574647.220270:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574647.220279:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346872704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574647.220340:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346872704:12345-0@lo:400:kworker.0 Request processed in 62us (2444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574647.220356:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574647.220372:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574647.220379:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346872448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574647.220416:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346872448:12345-0@lo:400:kworker.0 Request processed in 38us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574647.220422:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574647.220466:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346872448:0@lo:400:kworker.0 00000100:00100000:2.0:1787574647.221363:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346872320:0@lo:400:kworker.0 00010000:00080000:2.0:1787574647.221383:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca40429b480 x1874407346873088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574647.221394:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346873088:0@lo:400:kworker.0 00000100:00100000:2.0:1787574647.221404:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346872704:0@lo:400:kworker.0 00010000:00080000:2.0:1787574647.221437:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca404298a80 x1874407346872832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574647.221446:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574647.221455:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787574647.221465:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787574647.221470:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787574647.221473:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca536be9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787574647.221498:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787574647.221504:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346872832:0@lo:8:kworker.0 00000004:00080000:3.0:1787574647.221597:0:17885:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787574647.221622:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1874407346873600:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787574647.221670:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574647.221691:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574647.221702:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574647.221710:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346873472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574647.221747:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574647.221810:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346873472 00000100:00100000:2.0:1787574647.221816:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346873472 00000100:00100000:2.0:1787574647.223982:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574647.224001:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346873472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574647.224036:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787574647.224115:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346873472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574647.224123:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:1.0:1787574647.227002:0:17884:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787574647.227113:0:17884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 586409872440ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787574647.227134:0:17884:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:1.0:1787574647.227316:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574647.227423:0:18652:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787574647.227432:0:18652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:3.0:1787574647.227605:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca404056a00 x1874407346873472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574647.227630:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346873472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574647.232203:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346873600 00000100:00100000:3.0:1787574647.232218:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346873600 00000100:00100000:1.0:1787574647.233843:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574647.233873:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17885:x1874407346873600:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787574647.238829:0:17876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787574647.240111:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1874407346872960:12345-0@lo:8:kworker.0 Request processed in 20720us (21175us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787574647.240126:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787574647.241331:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574647.241342:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787574647.241346:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346872960:0@lo:8:kworker.0 00002000:00080000:3.0:1787574647.244540:0:18933:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787574647.244549:0:18933:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787574647.244657:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17885:x1874407346873600:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10787us (22970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574647.244668:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787574647.244722:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca404055180 x1874407346873600/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787574663 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574647.244761:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1874407346873600:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787574647.244774:0:17885:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787574647.244819:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1874407346873728:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787574647.244853:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574647.245093:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574647.245116:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346873728 00000100:00100000:3.0:1787574647.245122:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346873728 00000100:00100000:3.0:1787574647.245162:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574647.245171:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17885:x1874407346873728:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787574647.245198:0:18652:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787574647.245229:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17885:x1874407346873728:12345-0@lo:5:osp-pre-0-1.0 Request processed in 60us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574647.245235:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787574647.245311:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca404055180 x1874407346873728/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574663 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574647.245320:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1874407346873728:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787574647.245329:0:17885:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787574647.245355:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1874407346873856:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787574647.245379:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574647.245396:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574647.245407:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346873856 00000100:00100000:3.0:1787574647.245411:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346873856 00000100:00100000:3.0:1787574647.245435:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574647.245441:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17885:x1874407346873856:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787574647.245473:0:18652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1787574647.301818:0:18646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787574647.301836:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787574647.305210:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17885:x1874407346873856:12345-0@lo:5:osp-pre-0-1.0 Request processed in 59757us (59818us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787574647.305226:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787574647.305805:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca404055180 x1874407346873856/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574663 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574647.305818:0:17885:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787574647.305824:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1874407346873856:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787574647.305840:0:17885:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787574647.306355:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17885:1874407346873984:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787574647.306410:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574647.307749:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574647.314262:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346873984 00000100:00100000:0.0:1787574647.314278:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346873984 00000100:00100000:0.0:1787574647.314336:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574647.314347:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17885:x1874407346873984:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787574647.314449:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17885:x1874407346873984:12345-0@lo:900:osp-pre-0-1.0 Request processed in 104us (8037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574647.314457:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787574647.314509:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca404055180 x1874407346873984/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787574663 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574647.314525:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17885:1874407346873984:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1787574648.180393:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574648.497943:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787574648.571358:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346874112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574648.571433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574648.571491:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346874112 00000100:00100000:2.0:1787574648.571499:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346874112 00000100:00100000:2.0:1787574648.571549:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574648.571558:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346874112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574648.571589:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787574648.571647:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346874112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574648.571655:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574648.571699:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346874112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574648.574619:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346874240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574648.574704:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574648.575087:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346874240 00000100:00100000:1.0:1787574648.575096:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346874240 00000100:00100000:1.0:1787574648.575151:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787574648.575161:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346874240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574648.575191:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787574648.575273:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346874240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574648.575280:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574648.575497:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346874240:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787574649.203992:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787574649.443680:0:19016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787574650.234013:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787574650.617053:0:19068:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574650.617802:0:19068:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574651.261955:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574651.313342:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574631/real 1787574631] req@ffff9ca53be5c380 x1874407346863872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574651 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574651.313378:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca53be5c380 x1874407346863872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574651 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574651.313414:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574631/real 1787574631] req@ffff9ca53be5f800 x1874407346864000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574651 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574651.313425:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca53be5f800 x1874407346864000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574651 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787574651.313443:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574651.313513:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787574651.313518:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346863872:0@lo:8:kworker.0 00000100:00080000:0.0:1787574651.313524:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574651.319157:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574651.319164:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787574651.319181:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574651.319191:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 570 00000100:00080000:2.0:1787574651.319196:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787574651.319204:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ca51ebe0800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574651.319229:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca4040bed80 x1874407346874624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574651.319259:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574651.319262:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787574651.319264:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574651.319267:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 570 00000100:00080000:2.0:1787574651.319269:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787574651.319273:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca4037f4000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574651.319286:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca4040bfb80 x1874407346874752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574651.319308:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574651.319311:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787574651.319313:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574651.319316:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 586 00000100:00080000:2.0:1787574651.319319:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787574651.319321:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca4033de800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574651.319331:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca4040bc700 x1874407346875264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574651.319384:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346875008:0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.319449:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574651.319486:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346875648:0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.319513:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574651.319543:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787574651.319547:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346874368:0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.319571:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574651.319597:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346875136:0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.319633:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574651.319662:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346874880:0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.319684:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574651.319719:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346875520:0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.319742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574651.319760:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787574651.319765:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346874496:0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.319785:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574651.319802:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346875392:0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.319821:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574651.319863:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346875008 00000100:00100000:2.0:1787574651.319874:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346875008 00000100:00100000:2.0:1787574651.319925:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346874496 00000100:00100000:2.0:1787574651.319928:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346874496 00000100:00100000:2.0:1787574651.319946:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574651.319956:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346875008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.320011:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346875008:12345-0@lo:400:kworker.0 Request processed in 56us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574651.320019:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574651.320037:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787574651.320057:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346874496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.320090:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346874496:12345-0@lo:400:kworker.0 Request processed in 35us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574651.320096:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787574651.320117:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346874368 00000100:00100000:2.0:1787574651.320121:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346874368 00000100:00100000:2.0:1787574651.320146:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787574651.320152:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:3634:x1874407346874368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.320183:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:3634:x1874407346874368:12345-0@lo:400:kworker.0 Request processed in 31us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574651.320189:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787574651.320223:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346875136 00000100:00100000:2.0:1787574651.320227:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346875136 00000100:00100000:2.0:1787574651.320291:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574651.320298:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346875136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.320329:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346875136:12345-0@lo:400:kworker.0 Request processed in 33us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574651.320334:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574651.320351:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346875648 00000100:00100000:2.0:1787574651.320354:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346875648 00000100:00100000:2.0:1787574651.320371:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346874880 00000100:00100000:2.0:1787574651.320374:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346874880 00000100:00100000:2.0:1787574651.320382:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346875520 00000100:00100000:2.0:1787574651.320385:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346875520 00000100:00100000:2.0:1787574651.320393:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346875392 00000100:00100000:2.0:1787574651.320395:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346875392 00000100:00100000:2.0:1787574651.320405:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574651.320410:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346875648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.320454:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346875648:12345-0@lo:400:kworker.0 Request processed in 44us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574651.320460:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574651.320472:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574651.320478:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346874880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.320504:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346874880:12345-0@lo:400:kworker.0 Request processed in 27us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574651.320510:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574651.320519:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574651.320524:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346875520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.320546:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346875520:12345-0@lo:400:kworker.0 Request processed in 22us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574651.320550:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574651.320559:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787574651.320564:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346875392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.320583:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346875392:12345-0@lo:400:kworker.0 Request processed in 20us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574651.320588:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787574651.320617:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574651.320621:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574651.320624:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574651.320653:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346874496:0@lo:400:kworker.0 00010000:00080000:2.0:1787574651.320665:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4040bc000 x1874407346875392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574651.320673:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346875392:0@lo:400:kworker.0 00010000:00080000:2.0:1787574651.320706:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4040bd180 x1874407346874880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574651.320715:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346874880:0@lo:400:kworker.0 00010000:00080000:2.0:1787574651.320728:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4040bca80 x1874407346875520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574651.320735:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346875520:0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.320768:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346874368:0@lo:400:kworker.0 00010000:00080000:2.0:1787574651.320778:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4040be680 x1874407346875136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574651.320786:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346875136:0@lo:400:kworker.0 00000100:00100000:2.0:1787574651.320794:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346875008:0@lo:400:kworker.0 00010000:00080000:2.0:1787574651.320802:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4040be300 x1874407346875648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574651.320809:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346875648:0@lo:400:kworker.0 00000100:00080000:0.0:1787574651.321863:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787574651.321872:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346864000:0@lo:8:kworker.0 00000100:00100000:0.0:1787574651.321917:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346874624:0@lo:8:kworker.0 00000100:00100000:0.0:1787574651.321974:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574651.322009:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346874752:0@lo:8:kworker.0 00000100:00100000:0.0:1787574651.322031:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574651.322055:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346874624 00000100:00100000:0.0:1787574651.322061:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346874624 00000100:00100000:0.0:1787574651.322087:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346874752 00000100:00100000:0.0:1787574651.322090:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346874752 00000100:00100000:0.0:1787574651.322100:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574651.322106:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3633:x1874407346874624:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787574651.322135:0:18652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:0.0:1787574651.322167:0:18652:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb92a7 00002000:00100000:0.0:1787574651.322181:0:18652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ca402031000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787574651.322199:0:18652:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787574651.322202:0:18652:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787574651.322302:0:18652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787574651.322328:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9ca402033000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574651.322466:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574651.322473:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3633:x1874407346874752:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787574651.322485:0:18933:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787574651.322524:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3633:x1874407346874752:12345-0@lo:8:kworker.0 Request processed in 50us (492us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787574651.322531:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574651.324114:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1874407346874624:12345-0@lo:8:kworker.0 Request processed in 1997us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574651.324129:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787574651.324221:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574651.324227:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787574651.324232:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346874752:0@lo:8:kworker.0 00000100:00100000:0.0:1787574651.324260:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346875264:0@lo:8:kworker.0 00000100:00100000:0.0:1787574651.324299:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787574651.324434:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4040bed80 x1874407346874624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574651.324445:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787574651.324452:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787574651.324461:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787574651.324467:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787574651.324470:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787574651.324485:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787574651.324490:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346874624:0@lo:8:kworker.0 00000100:00100000:1.0:1787574651.324615:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346875264 00000100:00100000:1.0:1787574651.324623:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346875264 00000100:00100000:1.0:1787574651.324657:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574651.324663:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3633:x1874407346875264:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787574651.324707:0:18933:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787574651.324753:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3633:x1874407346875264:12345-0@lo:8:kworker.0 Request processed in 88us (453us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787574651.324760:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787574651.325873:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574651.325883:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787574651.325887:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346875264:0@lo:8:kworker.0 00000004:00080000:2.0:1787574651.329190:0:17168:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1787574651.329222:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1874407346875904:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787574651.329329:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574651.329364:0:17168:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea2600 going to sleep for 11 seconds 00000004:00080000:2.0:1787574651.329386:0:17167:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787574651.329489:0:17167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 590512248295ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787574651.329496:0:17167:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787574651.329828:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346875904 00000100:00100000:0.0:1787574651.329846:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346875904 00000100:00100000:0.0:1787574651.329913:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574651.329923:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17168:x1874407346875904:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787574651.334460:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346875776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574651.334537:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787574651.336587:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574651.337045:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346875776 00000100:00100000:3.0:1787574651.337056:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346875776 00000100:00100000:3.0:1787574651.337142:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574651.337155:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1874407346875776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574651.337188:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574651.337306:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1874407346875776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (2767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574651.337314:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787574651.337538:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53bf8ea00 x1874407346875776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574651.337560:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346875776:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1787574651.338088:0:18651:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787574651.338099:0:18651:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787574651.338104:0:18651:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:3.0:1787574651.339346:0:17123:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787574651.362332:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787574651.362345:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f20d839/0xd18a1efeeddb92ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.362364:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1787574651.362369:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574651.362375:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f20d839/0xd18a1efeeddb92ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.362392:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f20d839/0xd18a1efeeddb92ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.362402:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f20d839/0xd18a1efeeddb92ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.362415:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f20d839/0xd18a1efeeddb92ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.362447:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574651.362719:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574651.362727:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f20d839/0xd18a1efeeddb92ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.362736:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.362741:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f20d839/0xd18a1efeeddb92ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.362751:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f20d839/0xd18a1efeeddb92ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.362770:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f20d839/0xd18a1efeeddb92ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.362778:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f20d839/0xd18a1efeeddb92ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.362796:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.362798:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.362799:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787574651.363294:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787574651.363302:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6f278f/0xd18a1efeeddb92b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.363312:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1787574651.363316:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574651.363320:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6f278f/0xd18a1efeeddb92b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.363331:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd6f278f/0xd18a1efeeddb92b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.363338:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6f278f/0xd18a1efeeddb92b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.363346:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6f278f/0xd18a1efeeddb92b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.363361:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574651.363550:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574651.363555:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd6f278f/0xd18a1efeeddb92b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.363562:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.363572:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6f278f/0xd18a1efeeddb92b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.363580:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6f278f/0xd18a1efeeddb92b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.363592:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd6f278f/0xd18a1efeeddb92b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.363598:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd6f278f/0xd18a1efeeddb92b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.363618:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.363619:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.363621:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787574651.364406:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787574651.364416:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf124f4/0xd18a1efeeddb92bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.364434:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1787574651.364438:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574651.364443:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf124f4/0xd18a1efeeddb92bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.364454:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf124f4/0xd18a1efeeddb92bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.364462:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf124f4/0xd18a1efeeddb92bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.364469:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf124f4/0xd18a1efeeddb92bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.364493:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574651.364659:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574651.364666:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf124f4/0xd18a1efeeddb92bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.364674:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.364678:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf124f4/0xd18a1efeeddb92bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.364687:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf124f4/0xd18a1efeeddb92bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.364711:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf124f4/0xd18a1efeeddb92bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.364725:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf124f4/0xd18a1efeeddb92bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.364744:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.364745:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.364747:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787574651.365043:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787574651.365130:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cf2dd82/0xd18a1efeeddb92c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.365140:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1787574651.365144:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574651.365148:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cf2dd82/0xd18a1efeeddb92c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.365158:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cf2dd82/0xd18a1efeeddb92c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.365187:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cf2dd82/0xd18a1efeeddb92c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.365194:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cf2dd82/0xd18a1efeeddb92c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.365213:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574651.365493:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574651.365499:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cf2dd82/0xd18a1efeeddb92c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.365507:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.365511:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cf2dd82/0xd18a1efeeddb92c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.365519:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cf2dd82/0xd18a1efeeddb92c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.365531:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cf2dd82/0xd18a1efeeddb92c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.365538:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cf2dd82/0xd18a1efeeddb92c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.365550:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.365552:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.365554:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787574651.365734:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787574651.365740:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd3ec6d/0xd18a1efeeddb92ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.365748:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1787574651.365751:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574651.365755:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd3ec6d/0xd18a1efeeddb92ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.365763:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cd3ec6d/0xd18a1efeeddb92ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.365771:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd3ec6d/0xd18a1efeeddb92ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.365791:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cd3ec6d/0xd18a1efeeddb92ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.365852:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787574651.366633:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787574651.366642:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb92d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.366653:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1787574651.366656:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574651.366662:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb92d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.366670:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb92d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.366678:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb92d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.366684:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb92d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.368741:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574651.368755:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cd3ec6d/0xd18a1efeeddb92ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.368769:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.368774:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd3ec6d/0xd18a1efeeddb92ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.368785:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd3ec6d/0xd18a1efeeddb92ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.368804:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cd3ec6d/0xd18a1efeeddb92ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.368812:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cd3ec6d/0xd18a1efeeddb92ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.368831:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574651.368834:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb92d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.368840:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.368843:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb92d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.368849:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb92d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.369909:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb92d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.369922:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.369924:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.369927:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574651.371122:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787574651.371136:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb92d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574651.373363:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.373383:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb92d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.373399:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.373404:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.373410:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb92d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.373425:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb92d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.373436:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb92d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.373442:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb92d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.377939:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574651.377955:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb92d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.377969:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabe00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.377974:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb92d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.377985:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb92d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.378009:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb92d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.378017:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.378019:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.378021:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574651.379036:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787574651.379049:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb92d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.379325:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574651.379952:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.379961:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb92df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.379974:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.379979:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.379992:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb92df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.380006:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb92df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.380016:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb92df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.380023:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb92df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.380050:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787574651.380630:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.380639:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb92e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.380649:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.380652:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.380656:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb92e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.380666:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb92e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.380674:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb92e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.380702:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb92e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.380716:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787574651.382993:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574651.383012:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb92df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.383025:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faba00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574651.383030:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb92df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.383040:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb92df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.383060:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb92df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.383067:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb92df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574651.383068:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.383075:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb92ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.383086:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1787574651.383086:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574651.383089:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb92e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.383090:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.383096:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb92ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.383096:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574651.383099:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb92e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.383106:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb92e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.383109:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb92ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.383126:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb92e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.383133:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb92e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.383147:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574651.383149:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574651.383150:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574651.383157:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574651.387521:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb92ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.387541:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb92ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.387565:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574651.388176:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574651.388187:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb92ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.388197:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faae00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574651.388202:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb92ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.388213:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb92ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.388236:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb92ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.388257:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb92ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.388294:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574651.388295:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574651.388297:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574651.388783:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.388792:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb92f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.388811:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.388816:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.388824:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb92f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.388837:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb92f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.388846:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb92f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.388854:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb92f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.388876:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787574651.389391:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.389397:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb92fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.389407:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.389410:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.389414:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb92fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.389422:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb92fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.389439:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb92fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.389446:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb92fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.389458:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787574651.389507:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574651.389514:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb92f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.389522:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabc00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574651.389526:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb92f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.389535:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb92f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.389550:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb92f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.389558:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb92f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.389579:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574651.389582:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb92fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.389587:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574651.389597:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb92fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.389605:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb92fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.389777:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb92fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.389785:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb92fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.389800:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574651.389801:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574651.389803:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574651.389810:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787574651.391235:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787574651.391272:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb9302 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.391293:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1787574651.391297:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574651.391305:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb9302 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.391318:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb9302 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.391341:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb9302 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.391350:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb9302 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.391375:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574651.392502:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574651.392512:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb9302 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.392523:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574651.392528:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb9302 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.392538:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb9302 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.392558:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb9302 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.392566:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9d1f7ba/0xd18a1efeeddb9302 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.392582:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574651.392589:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574651.392592:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787574651.392802:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787574651.392810:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d9e04fc/0xd18a1efeeddb9309 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.392822:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1787574651.392827:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574651.392833:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d9e04fc/0xd18a1efeeddb9309 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.392844:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d9e04fc/0xd18a1efeeddb9309 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.392854:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d9e04fc/0xd18a1efeeddb9309 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.392862:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d9e04fc/0xd18a1efeeddb9309 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.392904:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574651.392935:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574651.392941:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d9e04fc/0xd18a1efeeddb9309 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.392948:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574651.392952:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d9e04fc/0xd18a1efeeddb9309 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.392959:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d9e04fc/0xd18a1efeeddb9309 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.392969:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d9e04fc/0xd18a1efeeddb9309 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.392975:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d9e04fc/0xd18a1efeeddb9309 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.392988:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574651.392990:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574651.392991:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787574651.395599:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787574651.395615:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e245ef/0xd18a1efeeddb9310 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.395631:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1787574651.395636:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574651.395642:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097e245ef/0xd18a1efeeddb9310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.395656:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097e245ef/0xd18a1efeeddb9310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.395666:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e245ef/0xd18a1efeeddb9310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.395674:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097e245ef/0xd18a1efeeddb9310 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.395714:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574651.395726:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574651.395733:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097e245ef/0xd18a1efeeddb9310 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.395741:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574651.395745:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e245ef/0xd18a1efeeddb9310 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.395754:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e245ef/0xd18a1efeeddb9310 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.395773:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097e245ef/0xd18a1efeeddb9310 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.395780:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097e245ef/0xd18a1efeeddb9310 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.395796:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574651.395798:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574651.395799:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574651.401560:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.401576:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb9317 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.401595:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.401601:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.401623:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb9317 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.401640:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb9317 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.401651:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb9317 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.401659:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb9317 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.401748:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787574651.402533:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.402542:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb931e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.402555:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.402559:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.402565:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb931e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.402576:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb931e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.402584:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb931e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.402605:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb931e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.402737:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574651.402746:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb9317 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.402754:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabe00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574651.402766:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb9317 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.402775:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb9317 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.402791:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb9317 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.402797:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abe90b5/0xd18a1efeeddb9317 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.402818:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574651.402821:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb931e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.402828:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574651.402831:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb931e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.402838:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb931e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.402848:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb931e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574651.402855:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574651.402861:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574651.402863:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574651.404562:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787574651.404576:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb931e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.404880:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574651.407406:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.407421:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb9325 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.407440:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.407446:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.407452:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb9325 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.407466:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb9325 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.407476:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb9325 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.407484:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb9325 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.407522:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574651.407702:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574651.407709:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb9325 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.407728:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.407733:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb9325 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.407742:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb9325 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.407759:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb9325 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.407766:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e67ed696/0xd18a1efeeddb9325 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.407784:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.407786:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.407788:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574651.409632:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.409645:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb932c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.409661:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.409665:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.409671:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb932c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.409685:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb932c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.409705:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb932c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.409713:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb932c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.409778:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574651.412507:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574651.412522:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb932c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.412537:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabc00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574651.412541:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb932c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.412562:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb932c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.412588:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb932c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.412598:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060460c35/0xd18a1efeeddb932c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.412710:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574651.412713:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574651.412715:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574651.413499:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.413512:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb9333 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.413541:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.413546:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.413553:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb9333 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.413567:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb9333 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.413576:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb9333 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.413584:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb9333 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.413609:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574651.414143:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574651.414153:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb9333 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.414172:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faae00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.414177:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb9333 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.414186:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb9333 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.414211:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb9333 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.414220:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724c862e/0xd18a1efeeddb9333 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.414261:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.414263:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.414265:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574651.414716:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574651.414725:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1be3903/0xd18a1efeeddb933a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.414735:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1787574651.414739:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574651.414744:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1be3903/0xd18a1efeeddb933a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.414755:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1be3903/0xd18a1efeeddb933a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.414763:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1be3903/0xd18a1efeeddb933a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.414770:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1be3903/0xd18a1efeeddb933a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.414798:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787574651.415634:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574651.415643:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e37f41/0xd18a1efeeddb9341 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.415654:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1787574651.415659:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574651.415664:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e37f41/0xd18a1efeeddb9341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.415674:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e37f41/0xd18a1efeeddb9341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.415683:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e37f41/0xd18a1efeeddb9341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.415690:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e37f41/0xd18a1efeeddb9341 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.415764:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787574651.416555:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574651.416563:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9348 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.416574:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1787574651.416583:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574651.416589:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9348 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.416600:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9348 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.416608:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9348 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.416616:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9348 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417376:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787574651.417385:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1be3903/0xd18a1efeeddb933a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417396:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.417401:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1be3903/0xd18a1efeeddb933a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417410:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1be3903/0xd18a1efeeddb933a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417428:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1be3903/0xd18a1efeeddb933a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417435:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1be3903/0xd18a1efeeddb933a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417469:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574651.417472:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e37f41/0xd18a1efeeddb9341 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417479:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.417482:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e37f41/0xd18a1efeeddb9341 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417488:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e37f41/0xd18a1efeeddb9341 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417496:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e37f41/0xd18a1efeeddb9341 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417502:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e37f41/0xd18a1efeeddb9341 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417512:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574651.417514:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417520:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574651.417524:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417539:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9348 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417548:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9348 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574651.417554:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.417556:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574651.417558:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574651.420440:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574651.421579:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787574651.421594:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9348 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.421690:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574651.422774:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.422786:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb934f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.422802:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.422806:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.422812:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb934f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.422841:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb934f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.422850:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb934f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.422857:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb934f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.422878:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574651.423198:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574651.423205:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb934f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.423214:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574651.423219:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb934f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.423229:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb934f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.423273:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb934f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.423280:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d100b26d/0xd18a1efeeddb934f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.423296:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574651.423298:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574651.423300:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574651.424776:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.424791:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb9356 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.424807:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.424812:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.424817:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb9356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.424831:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb9356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.424840:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb9356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.424862:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb9356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.424893:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574651.425130:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574651.425138:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb9356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.425146:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574651.425150:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb9356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.425158:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb9356 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.425176:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb9356 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.425183:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bbc6356/0xd18a1efeeddb9356 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.425214:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574651.425216:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574651.425217:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574651.425685:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.425703:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb935d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.425713:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.425716:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.425721:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb935d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.425730:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb935d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.425738:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb935d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.425744:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb935d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.425763:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574651.426007:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574651.426013:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb935d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.426021:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faba00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574651.426025:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb935d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.426032:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb935d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.426045:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb935d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.426052:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1f4fc3c/0xd18a1efeeddb935d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.426068:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574651.426070:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574651.426071:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574651.426315:0:18651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574651.426320:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6bfba79/0xd18a1efeeddb9364 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.426630:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1787574651.426635:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574651.426641:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6bfba79/0xd18a1efeeddb9364 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.426652:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6bfba79/0xd18a1efeeddb9364 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.426661:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6bfba79/0xd18a1efeeddb9364 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.426668:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6bfba79/0xd18a1efeeddb9364 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574651.426728:0:18651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787574651.426775:0:18651:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1787574651.426889:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17168:x1874407346875904:12345-0@lo:5:osp-pre-0-0.0 Request processed in 96962us (97555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574651.426899:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574651.427016:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1874407346875904:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787574651.427032:0:17168:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787574651.427093:0:17168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1874407346876032:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787574651.427130:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574651.427326:0:17168:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787574651.428302:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346876032 00000100:00100000:2.0:1787574651.428312:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346876032 00000100:00100000:2.0:1787574651.428378:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574651.428388:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17168:x1874407346876032:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787574651.428429:0:18652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1787574651.433300:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574651.433314:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6bfba79/0xd18a1efeeddb9364 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.433425:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574651.433431:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6bfba79/0xd18a1efeeddb9364 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.433443:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6bfba79/0xd18a1efeeddb9364 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.433466:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6bfba79/0xd18a1efeeddb9364 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.433473:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6bfba79/0xd18a1efeeddb9364 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574651.433495:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574651.433496:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574651.433498:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787574651.444803:0:18646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1787574651.444851:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787574651.445159:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17168:x1874407346876032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16766us (18022us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787574651.445180:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787574651.445531:0:17168:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787574651.445541:0:17168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1874407346876032:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787574651.445558:0:17168:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:00000004:3.0:1787574651.577989:0:19118:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574651.578224:0:19118:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574652.273492:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574652.657953:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574652.657978:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346876160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574652.658049:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574652.658359:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346876160 00000100:00100000:1.0:1787574652.658368:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346876160 00000100:00100000:1.0:1787574652.658429:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574652.658439:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346876160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787574652.658472:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787574652.658526:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346876160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574652.658534:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574652.658585:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346876160:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787574653.298197:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574653.683939:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574653.683962:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346876288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574653.684033:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574653.684099:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346876288 00000100:00100000:2.0:1787574653.684107:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346876288 00000100:00100000:0.0:1787574653.685406:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346876416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574653.685452:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574653.696876:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346876416 00000100:00100000:2.0:1787574653.696894:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346876416 00000100:00100000:2.0:1787574653.696963:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787574653.696975:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346876288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574653.697021:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787574653.698418:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574653.698437:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346876416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574653.698470:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787574653.698539:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346876416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (13085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574653.698548:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574653.698707:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346876416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574653.699661:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346876288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2684us (15623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574653.699687:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574653.703831:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346876288:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787574654.322767:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574654.577938:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787574655.345343:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574656.373388:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574656.753584:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574656.753605:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346876544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574656.753699:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574656.753818:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346876544 00000100:00100000:2.0:1787574656.753827:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346876544 00000100:00100000:2.0:1787574656.753889:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574656.753900:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346876544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574656.753929:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787574656.753974:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346876544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574656.753981:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787574656.754038:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574656.754072:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346876544:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787574656.754278:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574656.754282:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787574656.754285:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574656.754290:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 590 00000100:00080000:3.0:1787574656.754294:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787574656.754299:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca4037f4000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574656.754320:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404055880 x1874407346876928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574656.754363:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574656.754366:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787574656.754368:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574656.754370:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 590 00000100:00080000:3.0:1787574656.754373:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787574656.754375:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca4033de800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574656.754385:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca535d45f80 x1874407346877440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574656.754417:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346877184:0@lo:400:kworker.0 00000100:00100000:3.0:1787574656.754448:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574656.754466:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346877824:0@lo:400:kworker.0 00000100:00100000:3.0:1787574656.754489:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574656.754508:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787574656.754513:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346877056:0@lo:400:kworker.0 00000100:00100000:3.0:1787574656.754545:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574656.754562:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346877696:0@lo:400:kworker.0 00000100:00100000:3.0:1787574656.754581:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574656.754604:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346877824 00000100:00100000:3.0:1787574656.754609:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346877824 00000100:00100000:3.0:1787574656.754659:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346877056 00000100:00100000:3.0:1787574656.754663:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346877056 00000100:00100000:3.0:1787574656.754675:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346877696 00000100:00100000:3.0:1787574656.754678:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346877696 00000100:00100000:3.0:1787574656.754691:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787574656.754697:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346877824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574656.754735:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346877824:12345-0@lo:400:kworker.0 Request processed in 38us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574656.754740:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787574656.754753:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574656.754759:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346877056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574656.754784:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346877056:12345-0@lo:400:kworker.0 Request processed in 26us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574656.754790:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787574656.754800:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574656.754807:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346877696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574656.754829:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346877696:12345-0@lo:400:kworker.0 Request processed in 23us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574656.754834:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787574656.754859:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca404055180 x1874407346877056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574656.754881:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346877056:0@lo:400:kworker.0 00010000:00080000:3.0:1787574656.754893:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca535d45880 x1874407346877696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574656.754900:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346877696:0@lo:400:kworker.0 00010000:00080000:3.0:1787574656.754907:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca535d47b80 x1874407346877824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574656.754914:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346877824:0@lo:400:kworker.0 00000100:00100000:1.0:1787574656.755211:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346876800:0@lo:400:kworker.0 00000100:00100000:1.0:1787574656.755273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574656.755305:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346877568:0@lo:400:kworker.0 00000100:00100000:1.0:1787574656.755326:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574656.755340:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787574656.755346:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346876672:0@lo:400:kworker.0 00000100:00100000:1.0:1787574656.755371:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574656.755391:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346877312:0@lo:400:kworker.0 00000100:00100000:1.0:1787574656.755413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574656.755449:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346877184 00000100:00100000:1.0:1787574656.755453:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346877184 00000100:00100000:1.0:1787574656.755480:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346876800 00000100:00100000:1.0:1787574656.755483:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346876800 00000100:00100000:1.0:1787574656.755495:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574656.755500:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346877184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574656.755537:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346877184:12345-0@lo:400:kworker.0 Request processed in 36us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574656.755543:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574656.755555:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787574656.755561:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346876800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574656.755591:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346876800:12345-0@lo:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574656.755597:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787574656.755625:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346876800:0@lo:400:kworker.0 00000100:00100000:0.0:1787574656.755767:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346877568 00000100:00100000:0.0:1787574656.755771:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346877568 00000100:00100000:0.0:1787574656.755808:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574656.755815:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346877568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574656.755852:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346877568:12345-0@lo:400:kworker.0 Request processed in 38us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574656.755858:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574656.755874:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346876672 00000100:00100000:0.0:1787574656.755877:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346876672 00000100:00100000:0.0:1787574656.755899:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787574656.755904:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:3637:x1874407346876672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574656.755929:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:3637:x1874407346876672:12345-0@lo:400:kworker.0 Request processed in 25us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574656.755934:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787574656.755955:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346877312 00000100:00100000:0.0:1787574656.755958:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346877312 00000100:00100000:0.0:1787574656.755984:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574656.755990:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346877312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574656.756015:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346877312:12345-0@lo:400:kworker.0 Request processed in 25us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574656.756020:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787574656.756035:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574656.756038:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574656.756041:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574656.756066:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346876672:0@lo:400:kworker.0 00000100:00100000:0.0:1787574656.756077:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346877312:0@lo:400:kworker.0 00010000:00080000:0.0:1787574656.756086:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca535d46680 x1874407346877568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574656.756095:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346877568:0@lo:400:kworker.0 00000100:00100000:2.0:1787574656.756188:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346876928:0@lo:8:kworker.0 00000100:00100000:2.0:1787574656.756217:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574656.756231:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346877440:0@lo:8:kworker.0 00000100:00100000:2.0:1787574656.756282:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574656.756320:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346876928 00000100:00100000:2.0:1787574656.756324:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346876928 00000100:00100000:2.0:1787574656.756339:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346877440 00000100:00100000:2.0:1787574656.756341:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346877440 00000100:00100000:2.0:1787574656.756348:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574656.756353:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3633:x1874407346876928:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787574656.756370:0:18651:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787574656.757196:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346877184:0@lo:400:kworker.0 00000100:00100000:0.0:1787574656.757357:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574656.757363:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1874407346877440:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787574656.757377:0:18650:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787574656.757426:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1874407346877440:12345-0@lo:8:kworker.0 Request processed in 62us (1143us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787574656.757433:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787574656.757476:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574656.757480:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787574656.757484:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346877440:0@lo:8:kworker.0 00000100:00100000:0.0:1787574656.790750:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3633:x1874407346876928:12345-0@lo:8:kworker.0 Request processed in 34387us (34524us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787574656.790764:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787574656.791114:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574656.791120:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787574656.791125:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346876928:0@lo:8:kworker.0 00010000:00010000:3.0:1787574657.398862:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574657.781502:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346877952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574657.781584:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574657.781657:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346877952 00000100:00100000:2.0:1787574657.781668:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346877952 00000100:00100000:3.0:1787574657.781793:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574657.781803:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346877952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574657.781829:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574657.781883:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346877952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574657.781890:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574657.781999:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346877952:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787574658.419888:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787574658.738069:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787574658.801674:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574658.801698:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346878208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574658.801768:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574658.801831:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346878208 00000100:00100000:2.0:1787574658.801841:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346878208 00000100:00100000:2.0:1787574658.801902:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574658.801913:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346878208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574658.801949:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787574658.801999:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346878208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574658.802006:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574658.802055:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346878208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574658.802147:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574658.802158:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346878080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574658.802188:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574658.802282:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346878080 00000100:00100000:2.0:1787574658.802287:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346878080 00000100:00100000:2.0:1787574658.802321:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787574658.802343:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346878080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574658.802375:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574658.802414:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346878080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574658.802421:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787574658.802452:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346878080:0@lo:41:osp-pre-1-0.0 00000020:01000004:1.0:1787574659.037961:0:19463:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787574659.037965:0:19463:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787574659.037967:0:19463:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787574659.038081:0:19463:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ca510a59000 00000020:01000004:1.0:1787574659.038096:0:19463:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787574659.038110:0:19463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787574659.038123:0:19463:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ca53b14b370) 00000020:00000080:1.0:1787574659.038138:0:19463:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787574659.096672:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787574659.104068:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787574659.104874:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787574659.105107:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787574659.105941:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787574659.107117:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787574659.107924:0:19463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1787574659.110132:0:19463:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787574659.110619:0:19463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787574659.110653:0:19463:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787574659.110666:0:19463:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd18a1efeeddb9372 00000020:01000004:3.0:1787574659.110674:0:19463:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787574659.110696:0:19463:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787574659.110699:0:19463:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787574659.110705:0:19463:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787574659.110748:0:19463:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787574659.110752:0:19463:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787574659.122142:0:19463:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787574659.122180:0:19463:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787574659.122185:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787574659.122187:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574659.122188:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574659.122189:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574659.122191:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574659.122192:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574659.122193:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574659.122195:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574659.122197:0:19463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787574659.122200:0:19463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787574659.122202:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787574659.122204:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574659.122205:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574659.122206:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574659.122207:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574659.122209:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574659.122210:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574659.122211:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574659.122212:0:19463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787574659.122575:0:19463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787574659.122597:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878336:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787574659.122679:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.122816:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50782cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574659.122905:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346878336 00000100:00100000:0.0:1787574659.122914:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346878336 00000100:00100000:0.0:1787574659.123000:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787574659.123010:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:19463:x1874407346878336:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787574659.123040:0:17135:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787574659.123044:0:17135:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787574659.123048:0:17135:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787574659.123523:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:19463:x1874407346878336:12345-0@lo:253:mount.lustre.0 Request processed in 512us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.123548:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787574659.123632:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878336:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787574659.123645:0:19463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787574659.123654:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787574659.123655:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574659.123656:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574659.123657:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574659.123658:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574659.123659:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574659.123660:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574659.123662:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574659.123662:0:19463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787574659.123684:0:19463:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca510a59000 from lustre-OST0001 10000000:01000000:3.0:1787574659.123711:0:19463:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787574659.123714:0:19463:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787574659.123722:0:19463:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ca4024c99b8 local copy 00010000:00010000:3.0:1787574659.123732:0:19463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574659.123837:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574659.123871:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.124295:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea2780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574659.124603:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346878464 00000100:00100000:2.0:1787574659.124610:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346878464 00000100:00100000:2.0:1787574659.124655:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787574659.124664:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:19463:x1874407346878464:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574659.124762:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:19463:x1874407346878464:12345-0@lo:501:mount.lustre.0 Request processed in 99us (889us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574659.124770:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787574659.124868:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878464:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787574659.124885:0:19463:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787574659.124907:0:19463:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787574659.124915:0:19463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574659.124924:0:19463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574659.124954:0:19463:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca510a59000 10000000:01000000:3.0:1787574659.124960:0:19463:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787574659.124966:0:19463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787574659.124979:0:19463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787574659.124984:0:19463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787574659.124987:0:19463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787574659.125014:0:19463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574659.125022:0:19463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574659.125030:0:19463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574659.125046:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574659.125076:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.125100:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574659.125133:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346878592 00000100:00100000:0.0:1787574659.125138:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346878592 00000100:00100000:0.0:1787574659.125161:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787574659.125168:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:19463:x1874407346878592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574659.125177:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574659.125190:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409d800/0xd18a1efeeddb9380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9379 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.125211:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409d800/0xd18a1efeeddb9380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9379 expref: 22 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.125221:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409d800/0xd18a1efeeddb9380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9379 expref: 22 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.125230:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d800, rc 0) 00000100:00100000:0.0:1787574659.125305:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:19463:x1874407346878592:12345-0@lo:101:mount.lustre.0 Request processed in 136us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.125312:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787574659.125531:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574659.125554:0:19463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574659.125563:0:19463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574659.127053:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787574659.127918:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574659.131709:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787574659.131769:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787574659.131784:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787574659.131797:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787574659.131810:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787574659.131822:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787574659.131862:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787574659.131869:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787574659.131980:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574659.132051:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.132123:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574659.132158:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346878720 00000100:00100000:0.0:1787574659.132164:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346878720 00000100:00100000:0.0:1787574659.132260:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787574659.132278:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:19463:x1874407346878720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574659.132397:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:19463:x1874407346878720:12345-0@lo:501:mount.lustre.0 Request processed in 129us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.132402:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787574659.132476:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574659.132509:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574659.132548:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.132752:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574659.132823:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346878848 00000100:00100000:2.0:1787574659.132830:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346878848 00000100:00100000:2.0:1787574659.132854:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787574659.132862:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:19463:x1874407346878848:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574659.133479:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:19463:x1874407346878848:12345-0@lo:503:mount.lustre.0 Request processed in 617us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.133485:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787574659.133688:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878848:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787574659.134040:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574659.134102:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574659.134134:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.134163:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea2780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574659.134254:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346878976 00000100:00100000:2.0:1787574659.134259:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346878976 00000100:00100000:2.0:1787574659.134300:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787574659.134308:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:19463:x1874407346878976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574659.134695:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:19463:x1874407346878976:12345-0@lo:502:mount.lustre.0 Request processed in 386us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.134703:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787574659.134786:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346878976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574659.134927:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787574659.134952:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787574659.134968:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787574659.134981:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787574659.134995:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787574659.135009:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787574659.135020:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787574659.135029:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787574659.135036:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787574659.135053:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574659.135080:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.135099:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574659.135147:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346879104 00000100:00100000:0.0:1787574659.135155:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346879104 00000100:00100000:0.0:1787574659.135181:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787574659.135186:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:19463:x1874407346879104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574659.135267:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:19463:x1874407346879104:12345-0@lo:502:mount.lustre.0 Request processed in 81us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.135274:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787574659.135425:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574659.135453:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787574659.135458:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1787574659.136170:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787574659.136178:0:19467:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787574659.136183:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574659.136185:0:19467:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787574659.136189:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574659.136201:0:19467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ca52e6f4d28) 00000020:00000080:2.0:1787574659.136219:0:19467:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787574659.136222:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787574659.136468:0:19467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca510a59000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787574659.136474:0:19467:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787574659.136480:0:19467:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd18a1efeeddb938e 00010000:00010000:2.0:1787574659.139607:0:19467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1787574659.140027:0:19467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1787574659.141501:0:19467:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1787574659.142446:0:19467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787574659.142458:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574659.142463:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574659.142465:0:19467:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787574659.142467:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574659.142470:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574659.142471:0:19467:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787574659.142473:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787574659.142474:0:19467:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787574659.142476:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574659.142477:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574659.142477:0:19467:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787574659.142484:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574659.142485:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574659.142486:0:19467:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787574659.142488:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787574659.142512:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574659.142515:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574659.142516:0:19467:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787574659.142519:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787574659.150745:0:19463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787574659.150783:0:19463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787574659.150805:0:19463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574659.150816:0:19463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574659.150821:0:19463:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca510a59000 from 1 10000000:01000000:3.0:1787574659.150824:0:19463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574659.150865:0:19463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574659.150874:0:19463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574659.150886:0:19463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574659.150910:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574659.150977:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.151055:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574659.154663:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346879232 00000100:00100000:0.0:1787574659.154679:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346879232 00000100:00100000:0.0:1787574659.154778:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787574659.154790:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:19463:x1874407346879232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574659.154807:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574659.154827:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb939c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9395 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.154854:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb939c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9395 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.154866:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb939c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9395 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.154875:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409dc00, rc 0) 00000100:00100000:0.0:1787574659.154961:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:19463:x1874407346879232:12345-0@lo:101:mount.lustre.0 Request processed in 174us (3984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.154966:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787574659.155035:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574659.155048:0:19463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574659.155071:0:19463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574659.157874:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787574659.158142:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574659.158360:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787574659.158387:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787574659.158405:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787574659.158411:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787574659.158481:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574659.158671:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.158985:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574659.159050:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346879360 00000100:00100000:2.0:1787574659.159060:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346879360 00000100:00100000:2.0:1787574659.159104:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787574659.159113:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:19463:x1874407346879360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574659.159257:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:19463:x1874407346879360:12345-0@lo:501:mount.lustre.0 Request processed in 124us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.159265:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787574659.159382:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574659.159418:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574659.159469:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.159496:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574659.159551:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346879488 00000100:00100000:0.0:1787574659.159556:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346879488 00000100:00100000:0.0:1787574659.159580:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787574659.159586:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:19463:x1874407346879488:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574659.159691:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:19463:x1874407346879488:12345-0@lo:503:mount.lustre.0 Request processed in 104us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.159698:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787574659.159835:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879488:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787574659.160122:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574659.160170:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574659.160198:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.160217:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574659.160275:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346879616 00000100:00100000:2.0:1787574659.160280:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346879616 00000100:00100000:2.0:1787574659.160301:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787574659.160307:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:19463:x1874407346879616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574659.160388:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:19463:x1874407346879616:12345-0@lo:502:mount.lustre.0 Request processed in 79us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.160394:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787574659.160473:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574659.160642:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787574659.160667:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787574659.160682:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787574659.160706:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787574659.160715:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787574659.160722:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787574659.160728:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787574659.160735:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787574659.160742:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787574659.160749:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787574659.160756:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787574659.160779:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574659.160803:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.160835:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510ea2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574659.161119:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346879744 00000100:00100000:2.0:1787574659.161124:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346879744 00000100:00100000:2.0:1787574659.161140:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787574659.161144:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:19463:x1874407346879744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574659.161209:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:19463:x1874407346879744:12345-0@lo:502:mount.lustre.0 Request processed in 64us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.161214:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787574659.161805:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574659.161854:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787574659.161865:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787574659.162413:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574659.162423:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574659.162425:0:19471:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787574659.162432:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca510a59000 00000020:00000080:3.0:1787574659.162434:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787574659.162441:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574659.162444:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574659.162445:0:19471:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787574659.162447:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574659.162450:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574659.162451:0:19471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787574659.162453:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca510a59000 00000020:00000080:3.0:1787574659.162454:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787574659.162508:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574659.162512:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574659.162513:0:19471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787574659.162515:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574659.162526:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574659.162528:0:19471:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787574659.162532:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca510a59000 00000020:00000080:3.0:1787574659.162533:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787574659.163414:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574659.163420:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574659.163421:0:19471:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787574659.163424:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574659.163427:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574659.163428:0:19471:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787574659.163432:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca510a59000 00000020:00000080:3.0:1787574659.163434:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787574659.163459:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574659.163462:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574659.163462:0:19471:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787574659.163464:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787574659.172907:0:19463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787574659.172949:0:19463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574659.172976:0:19463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.172986:0:19463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574659.173032:0:19463:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787574659.173034:0:19463:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca510a59000 10000000:01000000:0.0:1787574659.173036:0:19463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca510a59000 10000000:01000000:0.0:1787574659.173039:0:19463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787574659.173042:0:19463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca510a59000 from 1 10000000:01000000:0.0:1787574659.173044:0:19463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574659.173073:0:19463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.173079:0:19463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.173087:0:19463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574659.173106:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787574659.173161:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.173188:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40237d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787574659.173212:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346879872 00000100:00100000:0.0:1787574659.173217:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346879872 00000100:00100000:0.0:1787574659.173275:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787574659.173285:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:19463:x1874407346879872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574659.173299:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574659.173313:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409ce00/0xd18a1efeeddb93aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb93a3 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.173338:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409ce00/0xd18a1efeeddb93aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb93a3 expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.173349:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409ce00/0xd18a1efeeddb93aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb93a3 expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.173358:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409ce00, rc 0) 00000100:00100000:0.0:1787574659.173395:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346879872:12345-0@lo:101:mount.lustre.0 Request processed in 112us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.173402:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787574659.173448:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346879872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574659.173461:0:19463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.173470:0:19463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574659.181170:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787574659.181490:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574659.181727:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787574659.181752:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787574659.181777:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787574659.181789:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787574659.181796:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787574659.181803:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787574659.181809:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787574659.181816:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787574659.181823:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787574659.181829:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787574659.181836:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787574659.181843:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787574659.181849:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787574659.181856:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787574659.181874:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787574659.181882:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787574659.181888:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787574659.181900:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787574659.181914:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787574659.181926:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787574659.181938:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787574659.181951:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787574659.181964:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787574659.181976:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787574659.181983:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787574659.181990:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787574659.181997:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787574659.182003:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787574659.182010:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787574659.182017:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787574659.182379:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787574659.182402:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787574659.182414:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787574659.182426:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787574659.182440:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787574659.182460:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787574659.182467:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787574659.182474:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787574659.182481:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787574659.182488:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787574659.182499:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787574659.182512:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787574659.182522:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787574659.182535:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787574659.182548:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787574659.182562:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787574659.182588:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787574659.182593:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787574659.182693:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346880000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574659.182749:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.182780:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40237dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574659.182805:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346880000 00000100:00100000:0.0:1787574659.182811:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346880000 00000100:00100000:0.0:1787574659.182843:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787574659.182849:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346880000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574659.182938:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346880000:12345-0@lo:501:mount.lustre.0 Request processed in 89us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.182944:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787574659.182979:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346880000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574659.183000:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346880128:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574659.183029:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.185527:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40237dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574659.189229:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346880128 00000100:00100000:2.0:1787574659.189254:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346880128 00000100:00100000:2.0:1787574659.189310:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787574659.189321:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346880128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574659.189489:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346880128:12345-0@lo:503:mount.lustre.0 Request processed in 170us (6458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.189497:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787574659.189878:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346880128:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787574659.190306:0:19463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787574659.190387:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346880256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574659.190443:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.190475:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40239eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574659.190928:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346880256 00000100:00100000:2.0:1787574659.190934:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346880256 00000100:00100000:2.0:1787574659.190975:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787574659.190981:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346880256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574659.191084:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346880256:12345-0@lo:502:mount.lustre.0 Request processed in 102us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.191092:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787574659.191681:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346880256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574659.191889:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787574659.191919:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787574659.191932:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787574659.191945:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787574659.191959:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787574659.191973:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787574659.191986:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787574659.191999:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787574659.192012:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787574659.192025:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787574659.192036:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787574659.192049:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787574659.192062:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787574659.192075:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787574659.192089:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787574659.192102:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787574659.192113:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787574659.192124:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787574659.192136:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787574659.192147:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787574659.192159:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787574659.192172:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787574659.192182:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787574659.192189:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787574659.192208:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787574659.192216:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787574659.192222:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787574659.192229:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787574659.192235:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787574659.192260:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787574659.192270:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787574659.192295:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787574659.192307:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787574659.192320:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787574659.192332:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787574659.192345:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787574659.192356:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787574659.192367:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787574659.192380:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787574659.192393:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787574659.192418:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787574659.192434:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787574659.192447:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787574659.192457:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787574659.192464:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787574659.192470:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787574659.192478:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787574659.192484:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787574659.192524:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346880384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574659.193698:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574659.193727:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5203ea480 going to sleep for 11 seconds 00000100:00100000:0.0:1787574659.194934:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346880384 00000100:00100000:0.0:1787574659.194944:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346880384 00000100:00100000:0.0:1787574659.194988:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787574659.194995:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346880384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574659.195125:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346880384:12345-0@lo:502:mount.lustre.0 Request processed in 130us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.195130:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787574659.198789:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346880384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787574659.199051:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787574659.199081:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787574659.199125:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346880512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574659.199195:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.199315:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509afa480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574659.200281:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346880512 00000100:00100000:2.0:1787574659.200289:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346880512 00000100:00100000:2.0:1787574659.200354:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787574659.200365:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346880512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574659.200479:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346880512:12345-0@lo:502:mount.lustre.0 Request processed in 117us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.200486:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787574659.206990:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346880512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574659.207121:0:19463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1787574659.207137:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787574659.208975:0:19477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787574659.208992:0:19477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ca52f333370) 00000020:00000080:3.0:1787574659.209017:0:19477:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1787574659.209094:0:19477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca510a59000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787574659.209099:0:19477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca510a59000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787574659.209101:0:19477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca510a59000 3 00010000:00080000:3.0:1787574659.209136:0:19477:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca4023fe000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1787574659.210723:0:19477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1787574659.210926:0:19477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787574659.210964:0:19477:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787574659.210976:0:19477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd18a1efeeddb93b8 00000100:00080000:3.0:1787574659.210986:0:19477:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574659.210991:0:19477:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ca4023fe000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574659.211027:0:19477:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca535d45880 x1874407346880640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574659.211084:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346880640:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787574659.211157:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.211199:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346880640 00000100:00100000:0.0:1787574659.211207:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346880640 00000100:00080000:3.0:1787574659.211216:0:19477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787574659.211259:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574659.211282:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874407346880640:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787574659.211303:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 598 last 0 00000020:00000080:0.0:1787574659.211330:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd18a1efeeddb93bf 00000004:00100000:0.0:1787574659.211345:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574659.211372:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9ca404429800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574659.211442:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874407346880640:12345-0@lo:38:llog_process_th.0 Request processed in 159us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.211448:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787574659.211520:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574659.211524:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787574659.211526:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574659.211530:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 595 00000100:00080000:0.0:1787574659.211533:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787574659.211547:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca4037f4000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574659.211560:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404299880 x1874407346881024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574659.211587:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574659.211590:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787574659.211592:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574659.211595:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 595 00000100:00080000:0.0:1787574659.211597:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787574659.211601:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca4033de800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574659.211610:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca404298e00 x1874407346881536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574659.211678:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346880768:0@lo:400:kworker.0 00000100:00100000:0.0:1787574659.211709:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.211728:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346881408:0@lo:400:kworker.0 00000100:00100000:0.0:1787574659.211751:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.211769:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787574659.211775:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346881280:0@lo:400:kworker.0 00000100:00100000:0.0:1787574659.211802:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.211819:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346881920:0@lo:400:kworker.0 00000100:00100000:0.0:1787574659.211838:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.211871:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346880896:0@lo:400:kworker.0 00000100:00100000:0.0:1787574659.211896:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.211912:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346881664:0@lo:400:kworker.0 00000100:00100000:0.0:1787574659.211930:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.211946:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787574659.211951:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346881152:0@lo:400:kworker.0 00000100:00100000:0.0:1787574659.211986:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.212002:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346881792:0@lo:400:kworker.0 00000100:00100000:0.0:1787574659.212036:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.212060:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346880768 00000100:00100000:0.0:1787574659.212064:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346880768 00000100:00100000:3.0:1787574659.215430:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346881024:0@lo:8:kworker.0 00000100:00100000:3.0:1787574659.215497:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.215542:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346881536:0@lo:8:kworker.0 00000100:00100000:3.0:1787574659.215588:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787574659.215640:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca535d45880 x1874407346880640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574659.215651:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574659.215661:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787574659.215669:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787574659.215674:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787574659.215677:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4023fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787574659.215685:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346880640:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787574659.215736:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346881408 00000100:00100000:3.0:1787574659.215742:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346881408 00000100:00100000:3.0:1787574659.215780:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346880896 00000100:00100000:3.0:1787574659.215782:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346880896 00000100:00100000:3.0:1787574659.215794:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346881024 00000100:00100000:3.0:1787574659.215795:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346881024 00000100:00100000:3.0:1787574659.215801:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346881536 00000100:00100000:3.0:1787574659.215802:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346881536 00000100:00100000:3.0:1787574659.215821:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574659.215827:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346881408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574659.215879:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346881408:12345-0@lo:400:kworker.0 Request processed in 53us (4128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574659.215885:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574659.215898:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574659.215902:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346880896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574659.215920:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346880896:12345-0@lo:400:kworker.0 Request processed in 19us (4025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574659.215923:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574659.215930:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574659.215933:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3633:x1874407346881024:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787574659.215962:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3633:x1874407346881024:12345-0@lo:8:kworker.0 Request processed in 29us (467us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787574659.215966:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574659.215972:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787574659.215974:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3633:x1874407346881536:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787574659.215989:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3633:x1874407346881536:12345-0@lo:8:kworker.0 Request processed in 13us (402us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787574659.215992:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787574659.216002:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574659.216018:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346881408:0@lo:400:kworker.0 00000100:00100000:3.0:1787574659.216037:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346880896:0@lo:400:kworker.0 00000100:00100000:3.0:1787574659.216049:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574659.216051:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574659.216053:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787574659.216055:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346881024:0@lo:8:kworker.0 00000100:00100000:3.0:1787574659.216067:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574659.216069:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574659.216071:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787574659.216073:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346881536:0@lo:8:kworker.0 00000100:00100000:2.0:1787574659.220351:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346881920 00000100:00100000:2.0:1787574659.220367:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346881920 00000100:00100000:2.0:1787574659.220438:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346881664 00000100:00100000:2.0:1787574659.220442:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346881664 00000100:00100000:2.0:1787574659.220454:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346881152 00000100:00100000:2.0:1787574659.220457:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346881152 00000100:00100000:2.0:1787574659.220467:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346881792 00000100:00100000:2.0:1787574659.220484:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346881792 00000100:00100000:2.0:1787574659.220513:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787574659.220524:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346881920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574659.220633:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346881920:12345-0@lo:400:kworker.0 Request processed in 101us (8782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.220642:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787574659.220660:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574659.220666:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346881664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574659.220700:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346881664:12345-0@lo:400:kworker.0 Request processed in 35us (8769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.220706:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574659.220715:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787574659.220721:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346881152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574659.220747:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346881152:12345-0@lo:400:kworker.0 Request processed in 26us (8761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.220753:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787574659.220764:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787574659.220770:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346881792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574659.220798:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346881792:12345-0@lo:400:kworker.0 Request processed in 29us (8762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.220804:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787574659.220920:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574659.220925:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787574659.220965:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca40403ad80 x1874407346881920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574659.220982:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346881920:0@lo:400:kworker.0 00010000:00080000:3.0:1787574659.221021:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca40429b800 x1874407346881152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574659.221031:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346881152:0@lo:400:kworker.0 00010000:00080000:3.0:1787574659.221043:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca40403a300 x1874407346881792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574659.221051:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346881792:0@lo:400:kworker.0 00010000:00080000:3.0:1787574659.221063:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca404038a80 x1874407346881664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574659.221071:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346881664:0@lo:400:kworker.0 00000100:00100000:0.0:1787574659.222536:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346881280 00000100:00100000:0.0:1787574659.222548:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346881280 00000100:00100000:2.0:1787574659.222633:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574659.222646:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346880768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574659.222736:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346880768:12345-0@lo:400:kworker.0 Request processed in 93us (11025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.222761:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574659.222781:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787574659.222788:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346881280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574659.222822:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346881280:12345-0@lo:400:kworker.0 Request processed in 34us (11019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574659.222827:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574659.223072:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346881280:0@lo:400:kworker.0 00000100:00100000:3.0:1787574659.223086:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346880768:0@lo:400:kworker.0 00000020:01000004:3.0:1787574659.223218:0:19477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787574659.223233:0:19477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ca52f330000) 00000020:00000080:3.0:1787574659.223304:0:19477:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1787574659.223386:0:19477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca510a59000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787574659.223391:0:19477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca510a59000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787574659.223393:0:19477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca510a59000 3 00010000:00080000:3.0:1787574659.223421:0:19477:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca53f45c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1787574659.225070:0:19477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1787574659.225287:0:19477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787574659.225332:0:19477:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787574659.225344:0:19477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd18a1efeeddb93cd 00000100:00080000:3.0:1787574659.225354:0:19477:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574659.225360:0:19477:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ca53f45c000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574659.225413:0:19477:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca535d45880 x1874407346882048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574659.225462:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1874407346882048:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787574659.225533:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574659.225600:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346882048 00000100:00100000:3.0:1787574659.225607:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346882048 00000100:00100000:3.0:1787574659.225654:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574659.225663:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874407346882048:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787574659.225692:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 598 last 0 00000020:00000080:3.0:1787574659.225726:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd18a1efeeddb93d4 00000004:00100000:3.0:1787574659.225744:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787574659.225791:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9ca4030ff000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574659.225852:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874407346882048:12345-0@lo:38:llog_process_th.0 Request processed in 188us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574659.225861:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787574659.225907:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca535d45880 x1874407346882048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574659.225923:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574659.225933:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787574659.225940:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787574659.225944:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787574659.225946:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca53f45c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787574659.225951:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1874407346882048:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787574659.225970:0:19477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1787574659.227765:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1787574659.227988:0:19463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787574659.228023:0:19463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787574659.228050:0:19463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574659.228063:0:19463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787574659.228131:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787574659.228133:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787574659.228135:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574659.228136:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574659.228137:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574659.228139:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574659.228140:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787574659.228142:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574659.228143:0:19463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787574659.228147:0:19463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787574659.228149:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787574659.228151:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787574659.228152:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574659.228154:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574659.228155:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574659.228156:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574659.228157:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787574659.228158:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574659.228159:0:19463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787574659.228187:0:19463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787574659.228208:0:19463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346882176:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787574659.228492:0:19463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574659.228567:0:19463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5203ea300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574659.233802:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346882176 00000100:00100000:2.0:1787574659.233819:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346882176 00000100:00100000:2.0:1787574659.233888:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787574659.233900:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:19463:x1874407346882176:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787574659.233931:0:17136:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787574659.233948:0:17136:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787574659.246715:0:17136:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787574659.246736:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787574659.246837:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787574659.246843:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787574659.246866:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.246884:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb928b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9284 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.246892:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca40409d200/0xd18a1efeeddb9299 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9292 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.246899:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.246948:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca40409d200/0xd18a1efeeddb9299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9292 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.246962:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca40409d200/0xd18a1efeeddb9299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9292 expref: 24 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574659.246976:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346882304:0@lo:104: 00000100:00100000:0.0:1787574659.247041:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574659.247096:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb928b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9284 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247105:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb928b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9284 expref: 24 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574659.247114:0:17159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346882432:0@lo:104: 00000100:00100000:0.0:1787574659.247137:0:17159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.247157:0:17159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509afa180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574659.247176:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346882304 00000100:00100000:0.0:1787574659.247183:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346882304 00000100:00100000:0.0:1787574659.247220:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346882432 00000100:00100000:0.0:1787574659.247223:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346882432 00000100:00100000:0.0:1787574659.247259:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574659.247269:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+4:17159:x1874407346882304:12345-0@lo:104: 00010000:00010000:0.0:1787574659.247355:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247407:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787574659.247414:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+4:17159:x1874407346882304:12345-0@lo:104: Request processed in 146us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.247428:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574659.247446:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574659.247453:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:17159:x1874407346882432:12345-0@lo:104: 00010000:00010000:0.0:1787574659.247461:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247496:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787574659.247502:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:17159:x1874407346882432:12345-0@lo:104: Request processed in 50us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.247508:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574659.247550:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346882304:0@lo:104: 00000100:00100000:0.0:1787574659.247562:0:17159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1874407346882432:0@lo:104: 00010000:00010000:0.0:1787574659.247579:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247597:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574659.247602:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247608:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74e00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574659.247613:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247632:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574659.247640:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574659.247653:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574659.247682:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247688:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574659.247708:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247715:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9292 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9299 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247726:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574659.247730:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247735:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574659.247738:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247745:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574659.247752:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574659.247757:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787574659.247770:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247776:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574659.247798:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247805:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be74200/0xd18a1efeeddb9284 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb928b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.247817:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574659.247819:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574659.247821:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574659.247827:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574659.247846:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346882560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574659.247877:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.247909:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346882688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574659.247930:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574659.247961:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346882560 00000100:00100000:0.0:1787574659.247966:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346882560 00010000:00010000:0.0:1787574659.247993:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca40409d200/0xd18a1efeeddb9299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9292 expref: 25 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574659.248011:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346882688 00000100:00100000:0.0:1787574659.248015:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346882688 00010000:00010000:0.0:1787574659.248025:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb928b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9284 expref: 26 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574659.248038:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574659.248045:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+26:3635:x1874407346882560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574659.248054:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574659.248058:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca40409d200/0xd18a1efeeddb9299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9292 expref: 26 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.248079:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca40409d200/0xd18a1efeeddb9299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9292 expref: 26 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.248092:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409d200/0xd18a1efeeddb9299 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9292 expref: 26 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.248103:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574659.248132:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+25:3635:x1874407346882560:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.248138:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574659.248151:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574659.248158:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3636:x1874407346882688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574659.248165:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574659.248169:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb928b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9284 expref: 24 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.248178:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb928b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9284 expref: 24 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.248187:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fb400/0xd18a1efeeddb928b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9284 expref: 24 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.248200:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.248207:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787574659.248218:0:17129:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010946088s 00010000:00010000:0.0:1787574659.248228:0:17129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.248235:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.248264:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.248270:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574659.249164:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:19463:x1874407346882176:12345-0@lo:253:mount.lustre.0 Request processed in 15263us (20670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574659.249176:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00010000:0.0:1787574659.250084:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574659.250092:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.250102:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.250132:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574659.250148:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574659.250266:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574659.250283:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574659.250289:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb93db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574659.250357:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:3636:x1874407346882688:12345-0@lo:103:ldlm_bl.0 Request processed in 2198us (2423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574659.250367:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574659.250414:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346882560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574659.250724:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346882688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574659.250799:0:19463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:19463:1874407346882176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574659.250813:0:19463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787574659.250817:0:19463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574659.250818:0:19463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787574659.250820:0:19463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574659.250821:0:19463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574659.250823:0:19463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574659.250824:0:19463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574659.250825:0:19463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574659.250827:0:19463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574659.250829:0:19463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787574659.250840:0:19463:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1787574659.252872:0:19463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787574659.255878:0:19463:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787574659.255889:0:19463:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787574659.255929:0:19463:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787574659.255977:0:19463:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787574659.255995:0:19463:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787574659.256023:0:19463:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787574659.256946:0:19463:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574659.257201:0:19463:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787574659.443444:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787574660.249053:0:19532:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574660.249570:0:19532:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574660.469803:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787574661.050699:0:17139:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574661.050708:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca4033ba000 from 10 10000000:01000000:1.0:1787574661.050714:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574661.050763:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574661.050775:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574661.050786:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574661.050811:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346882816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574661.050879:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574661.050926:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca508f8a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787574661.051010:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346882816 00000100:00100000:2.0:1787574661.051018:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346882816 00000100:00100000:2.0:1787574661.051066:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787574661.051073:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:17139:x1874407346882816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574661.051089:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574661.051100:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb93e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb93e2 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.051117:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb93e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb93e2 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.051124:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb93e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb93e2 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.051131:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faae00, rc 0) 00000100:00100000:2.0:1787574661.051164:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:17139:x1874407346882816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574661.051169:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787574661.051214:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346882816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574661.051225:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.051231:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574661.051291:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346882944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787574661.051322:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574661.051336:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574661.051349:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346882944 00000100:00100000:2.0:1787574661.051352:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346882944 00000100:00100000:2.0:1787574661.051374:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787574661.051379:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:17139:x1874407346882944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787574661.051394:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787574661.051406:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787574661.051408:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1787574661.051461:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:17139:x1874407346882944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 81us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574661.051466:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787574661.051493:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346882944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787574661.051546:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574661.051553:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.051562:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574661.051572:0:17139:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787574661.051574:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca53f52b800 from 10 10000000:01000000:2.0:1787574661.051577:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787574661.051592:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.051598:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.051616:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574661.051629:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346883072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574661.051655:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574661.051677:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574661.051689:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346883072 00000100:00100000:2.0:1787574661.051692:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346883072 00000100:00100000:2.0:1787574661.051715:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787574661.051721:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:17139:x1874407346883072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574661.051728:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574661.051736:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca502faba00/0xd18a1efeeddb93f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb93f0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.051749:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca502faba00/0xd18a1efeeddb93f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb93f0 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.051757:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca502faba00/0xd18a1efeeddb93f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb93f0 expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.051762:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faba00, rc 0) 00000100:00100000:2.0:1787574661.051788:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:17139:x1874407346883072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574661.051794:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787574661.051823:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346883072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574661.051833:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.051839:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574661.051874:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346883200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787574661.051901:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574661.051921:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574661.051933:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346883200 00000100:00100000:2.0:1787574661.051936:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346883200 00000100:00100000:2.0:1787574661.051956:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787574661.051960:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:17139:x1874407346883200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787574661.051968:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787574661.051975:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787574661.051977:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1787574661.052017:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:17139:x1874407346883200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 56us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574661.052021:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787574661.052041:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346883200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787574661.052066:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574661.052070:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574661.052075:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574661.491427:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574661.873516:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574661.873540:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346883328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574661.873620:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574661.873676:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346883328 00000100:00100000:2.0:1787574661.873683:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346883328 00000100:00100000:2.0:1787574661.873740:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574661.873750:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346883328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574661.873779:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787574661.873826:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346883328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574661.873848:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787574661.873870:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574661.873909:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346883328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787574662.520051:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574662.898817:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574662.898839:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346883456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574662.898907:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574662.899011:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346883456 00000100:00100000:0.0:1787574662.899019:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346883456 00000100:00100000:0.0:1787574662.899102:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574662.899112:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346883456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574662.899134:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787574662.899182:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346883456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574662.899188:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787574662.899255:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574662.899292:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346883456:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787574663.539107:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574663.923847:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346883584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574663.923925:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574663.923973:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574663.923982:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346883712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574663.924006:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574663.924035:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346883584 00000100:00100000:3.0:1787574663.924042:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346883584 00000100:00100000:3.0:1787574663.924081:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346883712 00000100:00100000:3.0:1787574663.924085:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346883712 00000100:00100000:3.0:1787574663.924103:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574663.924112:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346883584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574663.924146:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787574663.924192:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346883584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574663.924200:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574663.924217:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787574663.924223:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346883712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574663.924266:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787574663.924301:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346883712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574663.924308:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787574663.924346:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346883584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574663.924373:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346883712:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787574664.435740:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574664.435747:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787574664.435751:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574664.435763:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca4037f4000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574664.436740:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca40403b480 x1874407346884096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574664.436787:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574664.436792:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787574664.436794:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574664.436802:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca4033de800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574664.436814:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca40403ad80 x1874407346884480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574664.436883:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346884352:0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.436958:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.436994:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346884992:0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.437024:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.437048:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787574664.437056:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346883840:0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.437086:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.437133:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346884608:0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.437157:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.437174:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346885120:0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.437193:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.437214:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346883968:0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.437268:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.437287:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346884736:0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.437307:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.437317:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787574664.437321:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346884224:0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.437337:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.437346:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346884864:0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.437362:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.437384:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346884096:0@lo:8:kworker.0 00000100:00100000:0.0:1787574664.437403:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.437416:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346884480:0@lo:8:kworker.0 00000100:00100000:0.0:1787574664.437433:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.437457:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346884352 00000100:00100000:0.0:1787574664.437465:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346884352 00000100:00100000:0.0:1787574664.438022:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346883968 00000100:00100000:0.0:1787574664.438028:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346883968 00000100:00100000:0.0:1787574664.438044:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346884096 00000100:00100000:0.0:1787574664.438046:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346884096 00000100:00100000:0.0:1787574664.438054:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346884480 00000100:00100000:0.0:1787574664.438056:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346884480 00000100:00100000:0.0:1787574664.438067:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574664.438076:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346884352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.438140:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346884352:12345-0@lo:400:kworker.0 Request processed in 64us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574664.438147:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574664.438163:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574664.438171:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346883968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.438205:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346883968:12345-0@lo:400:kworker.0 Request processed in 36us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574664.438211:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574664.438222:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574664.438227:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3633:x1874407346884096:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787574664.438270:0:18651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 603 last 0 00000020:00000080:0.0:1787574664.438299:0:18651:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb93fe 00002000:00100000:0.0:1787574664.438315:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ca40442f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787574664.438319:0:18651:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787574664.438322:0:18651:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787574664.438686:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346884992 00000100:00100000:2.0:1787574664.438692:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346884992 00000100:00100000:2.0:1787574664.438717:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346884608 00000100:00100000:2.0:1787574664.438720:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346884608 00000100:00100000:2.0:1787574664.438732:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346885120 00000100:00100000:2.0:1787574664.438735:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346885120 00000100:00100000:2.0:1787574664.438750:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346884736 00000100:00100000:2.0:1787574664.438753:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346884736 00000100:00100000:2.0:1787574664.438764:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346884224 00000100:00100000:2.0:1787574664.438767:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346884224 00000100:00100000:2.0:1787574664.438777:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346884864 00000100:00100000:2.0:1787574664.438779:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346884864 00000100:00100000:2.0:1787574664.438791:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787574664.438797:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346884992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574664.438841:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346884992:12345-0@lo:400:kworker.0 Request processed in 43us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574664.438847:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787574664.438860:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574664.438866:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346884608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574664.438892:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346884608:12345-0@lo:400:kworker.0 Request processed in 27us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574664.438898:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574664.438909:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574664.438915:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346885120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574664.438954:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346885120:12345-0@lo:400:kworker.0 Request processed in 38us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574664.438960:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574664.438972:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574664.438978:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346884736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574664.439003:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346884736:12345-0@lo:400:kworker.0 Request processed in 26us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574664.439008:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574664.439018:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787574664.439024:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346884224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574664.439047:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346884224:12345-0@lo:400:kworker.0 Request processed in 24us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574664.439052:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787574664.439062:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574664.439068:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346884864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574664.439092:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346884864:12345-0@lo:400:kworker.0 Request processed in 25us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574664.439098:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574664.439119:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574664.439123:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3633:x1874407346884480:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787574664.439141:0:18933:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 603 last 0 00000020:00000080:2.0:1787574664.439159:0:18933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb9405 00002000:00100000:2.0:1787574664.439167:0:18933:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ca4035ba800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787574664.439170:0:18933:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787574664.439179:0:18933:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787574664.439214:0:18933:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787574664.439235:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9ca4035be800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574664.439294:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3633:x1874407346884480:12345-0@lo:8:kworker.0 Request processed in 169us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574664.439300:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00080000:0.0:1787574664.440678:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787574664.440710:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9ca40442d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574664.440775:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1874407346884096:12345-0@lo:8:kworker.0 Request processed in 2545us (3369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574664.440785:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574664.440829:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346883840 00000100:00100000:0.0:1787574664.440837:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346883840 00000100:00100000:0.0:1787574664.440875:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787574664.440884:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3636:x1874407346883840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.440925:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3636:x1874407346883840:12345-0@lo:400:kworker.0 Request processed in 41us (3838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574664.440939:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1787574664.440979:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574664.440985:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574664.440988:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787574664.441022:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40403b480 x1874407346884096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787574664.441040:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787574664.441048:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787574664.441054:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787574664.441056:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787574664.441075:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787574664.441082:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346884096:0@lo:8:kworker.0 00010000:00080000:0.0:1787574664.441098:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40403ad80 x1874407346884480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787574664.441107:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787574664.441111:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787574664.441113:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787574664.441115:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787574664.441127:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787574664.441131:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346884480:0@lo:8:kworker.0 00000004:00080000:0.0:1787574664.441186:0:17170:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1787574664.441205:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034df100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1874407346885376:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787574664.441257:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.441278:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50627d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574664.441291:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574664.441306:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346885248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574664.441332:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.441359:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346885248 00000100:00100000:0.0:1787574664.441364:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346885248 00000100:00100000:0.0:1787574664.441399:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574664.441406:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346885248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574664.441425:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787574664.441463:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346885248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574664.441469:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787574664.441484:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574664.443077:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346885376 00000100:00100000:2.0:1787574664.443095:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346885376 00000100:00100000:2.0:1787574664.443151:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574664.443161:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17170:x1874407346885376:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787574664.445643:0:17169:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787574664.445735:0:17169:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 603628494326ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787574664.445743:0:17169:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1787574664.445809:0:17887:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787574664.445837:0:17887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1874407346885632:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1787574664.445914:0:17887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574664.445951:0:17887:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5203ea600 going to sleep for 11 seconds 00000004:00080000:1.0:1787574664.445964:0:17886:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787574664.446010:0:17886:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 603628768951ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787574664.446015:0:17886:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:0.0:1787574664.446139:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034de680 x1874407346885248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574664.446163:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346885248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574664.446187:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346885504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574664.446216:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.446267:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346885504 00000100:00100000:0.0:1787574664.446273:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346885504 00000100:00100000:0.0:1787574664.446319:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574664.446328:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1874407346885504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574664.446348:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787574664.446392:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1874407346885504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574664.446399:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787574664.446418:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787574664.446444:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca404038a80 x1874407346884224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574664.446463:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346884224:0@lo:400:kworker.0 00010000:00080000:0.0:1787574664.446478:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034dc380 x1874407346884864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574664.446486:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346884864:0@lo:400:kworker.0 00000100:00100000:2.0:1787574664.451082:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346885632 00000100:00100000:2.0:1787574664.451095:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346885632 00000100:00100000:2.0:1787574664.451158:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574664.451169:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17887:x1874407346885632:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787574664.452387:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346883968:0@lo:400:kworker.0 00010000:00080000:0.0:1787574664.452405:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034dfb80 x1874407346884736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574664.452417:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346884736:0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.452469:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346883840:0@lo:400:kworker.0 00010000:00080000:0.0:1787574664.452484:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034ddc00 x1874407346884608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574664.452506:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346884608:0@lo:400:kworker.0 00010000:00080000:0.0:1787574664.452521:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034de300 x1874407346885120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574664.452529:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346885120:0@lo:400:kworker.0 00000100:00100000:0.0:1787574664.452541:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346884352:0@lo:400:kworker.0 00010000:00080000:0.0:1787574664.452552:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034dca80 x1874407346884992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574664.452561:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346884992:0@lo:400:kworker.0 00010000:00080000:0.0:1787574664.452608:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53be5fb80 x1874407346885504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574664.452636:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346885504:0@lo:13:osp-pre-1-1.0 00002000:00080000:3.0:1787574664.454303:0:18933:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787574664.454318:0:18933:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787574664.454325:0:18933:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:0.0:1787574664.458258:0:17876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1787574664.458356:0:17123:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787574664.465732:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574664.465747:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e37f41/0xd18a1efeeddb940c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.465766:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=603s v=(0 0) 00010000:00010000:3.0:1787574664.465772:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574664.465779:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e37f41/0xd18a1efeeddb940c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.465799:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e37f41/0xd18a1efeeddb940c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.465810:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e37f41/0xd18a1efeeddb940c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.465818:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e37f41/0xd18a1efeeddb940c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.465839:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574664.465852:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574664.465858:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e37f41/0xd18a1efeeddb940c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.465865:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.465871:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e37f41/0xd18a1efeeddb940c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.465892:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e37f41/0xd18a1efeeddb940c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.465913:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e37f41/0xd18a1efeeddb940c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.465921:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e37f41/0xd18a1efeeddb940c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.465938:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.465939:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.465941:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787574664.466471:0:18650:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787574664.466479:0:18650:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787574664.466595:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17887:x1874407346885632:12345-0@lo:7:osp-pre-1-1.0 Request processed in 15423us (20676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574664.466604:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574664.466673:0:17887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1874407346885632:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787574664.466687:0:17887:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787574664.466730:0:17887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1874407346885760:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787574664.466768:0:17887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574664.466792:0:17887:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574664.466809:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346885760 00000100:00100000:2.0:1787574664.466815:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346885760 00000100:00100000:2.0:1787574664.466853:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574664.466871:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17887:x1874407346885760:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787574664.466902:0:18652:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787574664.466935:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17887:x1874407346885760:12345-0@lo:5:osp-pre-1-1.0 Request processed in 65us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574664.466940:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574664.466965:0:17887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1874407346885760:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787574664.466973:0:17887:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787574664.466996:0:17887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1874407346885888:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787574664.467016:0:17887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574664.467030:0:17887:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574664.467041:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346885888 00000100:00100000:2.0:1787574664.467044:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346885888 00000100:00100000:2.0:1787574664.467064:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787574664.467071:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17887:x1874407346885888:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787574664.467095:0:18650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1787574664.469005:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574664.469018:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9413 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469036:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=603s v=(0 0) 00010000:00010000:3.0:1787574664.469042:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574664.469050:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9413 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469066:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9413 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469077:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9413 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469096:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9413 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469129:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787574664.469796:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574664.469804:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1be3903/0xd18a1efeeddb941a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469815:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=603s v=(0 0) 00010000:00010000:3.0:1787574664.469819:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574664.469824:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1be3903/0xd18a1efeeddb941a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469834:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1be3903/0xd18a1efeeddb941a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469843:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1be3903/0xd18a1efeeddb941a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469852:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1be3903/0xd18a1efeeddb941a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469873:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787574664.469887:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574664.469894:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9413 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469910:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.469916:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9413 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469925:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9413 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469943:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9413 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469951:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9413 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469974:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574664.469977:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1be3903/0xd18a1efeeddb941a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469984:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.469987:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1be3903/0xd18a1efeeddb941a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.469994:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1be3903/0xd18a1efeeddb941a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.470005:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1be3903/0xd18a1efeeddb941a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.470021:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1be3903/0xd18a1efeeddb941a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.470036:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.470038:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.470040:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.470284:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574664.472651:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574664.472665:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016414bdd/0xd18a1efeeddb9421 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.472681:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=603s v=(0 0) 00010000:00010000:3.0:1787574664.472686:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574664.472693:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016414bdd/0xd18a1efeeddb9421 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.472705:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016414bdd/0xd18a1efeeddb9421 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.472714:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016414bdd/0xd18a1efeeddb9421 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.472721:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016414bdd/0xd18a1efeeddb9421 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.472781:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787574664.476477:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.476505:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b52ff596/0xd18a1efeeddb9428 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.476522:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.476526:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.476533:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b52ff596/0xd18a1efeeddb9428 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.476547:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b52ff596/0xd18a1efeeddb9428 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.476557:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b52ff596/0xd18a1efeeddb9428 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.476565:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b52ff596/0xd18a1efeeddb9428 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.479307:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574664.479322:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016414bdd/0xd18a1efeeddb9421 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.479335:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574664.479340:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016414bdd/0xd18a1efeeddb9421 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.479351:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016414bdd/0xd18a1efeeddb9421 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.479391:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016414bdd/0xd18a1efeeddb9421 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.479400:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016414bdd/0xd18a1efeeddb9421 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.479424:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574664.479429:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b52ff596/0xd18a1efeeddb9428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.479436:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574664.479439:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b52ff596/0xd18a1efeeddb9428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.479446:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b52ff596/0xd18a1efeeddb9428 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.479455:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b52ff596/0xd18a1efeeddb9428 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.479463:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.479465:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.479467:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.483953:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787574664.483971:0:18933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b52ff596/0xd18a1efeeddb9428 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.485348:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574664.487879:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.487899:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d534f20c/0xd18a1efeeddb942f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.487925:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.487930:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.487938:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d534f20c/0xd18a1efeeddb942f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.487953:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d534f20c/0xd18a1efeeddb942f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.487964:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d534f20c/0xd18a1efeeddb942f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.487971:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d534f20c/0xd18a1efeeddb942f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.488003:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787574664.490793:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.490812:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bad7b97/0xd18a1efeeddb9436 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.490834:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.490839:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.490847:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bad7b97/0xd18a1efeeddb9436 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.490862:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bad7b97/0xd18a1efeeddb9436 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.490888:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bad7b97/0xd18a1efeeddb9436 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.490896:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bad7b97/0xd18a1efeeddb9436 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.490928:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787574664.490952:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574664.490960:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d534f20c/0xd18a1efeeddb942f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.490970:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409ca00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574664.490975:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d534f20c/0xd18a1efeeddb942f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.490986:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d534f20c/0xd18a1efeeddb942f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.491011:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d534f20c/0xd18a1efeeddb942f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.491020:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d534f20c/0xd18a1efeeddb942f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.491046:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574664.491056:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bad7b97/0xd18a1efeeddb9436 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.491063:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574664.491066:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bad7b97/0xd18a1efeeddb9436 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.491074:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bad7b97/0xd18a1efeeddb9436 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.491086:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bad7b97/0xd18a1efeeddb9436 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.491093:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bad7b97/0xd18a1efeeddb9436 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.491107:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.491108:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.491110:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.491269:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574664.495680:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.495695:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb943d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.495711:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.495715:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.495721:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb943d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.495751:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb943d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.495762:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb943d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.495771:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb943d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.495795:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574664.495812:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574664.495817:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb943d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.495826:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574664.495831:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb943d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.495841:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb943d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.495859:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb943d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.495867:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb943d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.495893:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.495895:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.495897:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574664.498954:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.498969:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049ab38bd/0xd18a1efeeddb9444 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.498985:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.498990:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.498997:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049ab38bd/0xd18a1efeeddb9444 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.499012:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049ab38bd/0xd18a1efeeddb9444 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.499022:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049ab38bd/0xd18a1efeeddb9444 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.499029:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049ab38bd/0xd18a1efeeddb9444 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.499065:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574664.499263:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574664.499279:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049ab38bd/0xd18a1efeeddb9444 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.499288:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.499292:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049ab38bd/0xd18a1efeeddb9444 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.499302:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049ab38bd/0xd18a1efeeddb9444 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.499319:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049ab38bd/0xd18a1efeeddb9444 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.499325:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049ab38bd/0xd18a1efeeddb9444 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.499343:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.499345:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.499347:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574664.502003:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.502016:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb944b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.502053:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.502058:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.502065:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb944b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.502079:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb944b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.502089:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb944b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.502097:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb944b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.503342:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574664.503366:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574664.503375:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb944b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.503387:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574664.503392:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb944b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.503403:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb944b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.503438:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb944b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.503446:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb944b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.503469:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.503471:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.503473:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574664.506608:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.506620:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbd22c9a/0xd18a1efeeddb9452 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.506639:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.506643:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.506650:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbd22c9a/0xd18a1efeeddb9452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.506663:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbd22c9a/0xd18a1efeeddb9452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.506673:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbd22c9a/0xd18a1efeeddb9452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.506681:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbd22c9a/0xd18a1efeeddb9452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.506711:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574664.506886:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574664.506893:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbd22c9a/0xd18a1efeeddb9452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.506901:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.506906:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbd22c9a/0xd18a1efeeddb9452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.506928:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbd22c9a/0xd18a1efeeddb9452 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.506945:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbd22c9a/0xd18a1efeeddb9452 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.506951:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbd22c9a/0xd18a1efeeddb9452 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.506969:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.506971:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.506972:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574664.510360:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.510376:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e9912e3/0xd18a1efeeddb9459 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.510393:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.510398:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.510405:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e9912e3/0xd18a1efeeddb9459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.510420:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e9912e3/0xd18a1efeeddb9459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.510430:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e9912e3/0xd18a1efeeddb9459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.510438:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e9912e3/0xd18a1efeeddb9459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.510456:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574664.511366:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574664.511390:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e9912e3/0xd18a1efeeddb9459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.511401:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574664.511405:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e9912e3/0xd18a1efeeddb9459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.511413:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e9912e3/0xd18a1efeeddb9459 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.511434:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e9912e3/0xd18a1efeeddb9459 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.511440:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e9912e3/0xd18a1efeeddb9459 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.511465:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.511466:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.511468:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574664.514321:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574664.514338:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb9460 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.514356:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=603s v=(0 0) 00010000:00010000:3.0:1787574664.514361:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574664.514368:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb9460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.514382:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb9460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.514392:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb9460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.514410:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb9460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.514431:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574664.514589:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574664.514595:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb9460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.514604:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574664.514609:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb9460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.514630:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb9460 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.514647:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb9460 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.514654:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c509034/0xd18a1efeeddb9460 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.514671:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.514673:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.514675:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574664.517463:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.517480:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb9467 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.517509:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.517521:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.517528:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb9467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.517543:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb9467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.517554:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb9467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.517560:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb9467 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.517589:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574664.518082:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574664.518090:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb9467 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.518099:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574664.518103:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb9467 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.518124:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb9467 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.518141:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb9467 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.518160:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dca7cf0/0xd18a1efeeddb9467 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.518179:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.518181:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.518183:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574664.535004:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574664.535018:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a4e99be/0xd18a1efeeddb946e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.535034:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1787574664.535038:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574664.535045:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a4e99be/0xd18a1efeeddb946e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.535060:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a4e99be/0xd18a1efeeddb946e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.535070:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a4e99be/0xd18a1efeeddb946e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.535077:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a4e99be/0xd18a1efeeddb946e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.535094:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787574664.535652:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574664.535666:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060460c35/0xd18a1efeeddb9475 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.535677:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1787574664.535680:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574664.535684:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060460c35/0xd18a1efeeddb9475 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.535693:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060460c35/0xd18a1efeeddb9475 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.535701:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060460c35/0xd18a1efeeddb9475 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.535708:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060460c35/0xd18a1efeeddb9475 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.535722:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787574664.535978:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574664.535987:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a4e99be/0xd18a1efeeddb946e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.535996:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.536001:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a4e99be/0xd18a1efeeddb946e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.536009:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a4e99be/0xd18a1efeeddb946e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.536026:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a4e99be/0xd18a1efeeddb946e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.536033:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a4e99be/0xd18a1efeeddb946e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.536054:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574664.536058:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060460c35/0xd18a1efeeddb9475 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.536076:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabc00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.536079:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060460c35/0xd18a1efeeddb9475 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.536087:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060460c35/0xd18a1efeeddb9475 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.536098:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060460c35/0xd18a1efeeddb9475 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.536105:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060460c35/0xd18a1efeeddb9475 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.536134:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.536135:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.536137:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.536294:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574664.538023:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574664.538036:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e67ed696/0xd18a1efeeddb947c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.538049:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1787574664.538053:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574664.538060:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e67ed696/0xd18a1efeeddb947c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.538072:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e67ed696/0xd18a1efeeddb947c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.538088:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e67ed696/0xd18a1efeeddb947c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.538095:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e67ed696/0xd18a1efeeddb947c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.540064:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:2.0:1787574664.545144:0:19464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787574664.545177:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787574664.545183:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1787574664.545322:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574664.545332:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abe90b5/0xd18a1efeeddb9483 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.545348:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1787574664.545353:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574664.545359:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abe90b5/0xd18a1efeeddb9483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.545372:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009abe90b5/0xd18a1efeeddb9483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.545381:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abe90b5/0xd18a1efeeddb9483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.545403:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009abe90b5/0xd18a1efeeddb9483 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574664.545606:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17887:x1874407346885888:12345-0@lo:5:osp-pre-1-1.0 Request processed in 78530us (78584us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787574664.545618:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787574664.545670:0:17887:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787574664.545679:0:17887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1874407346885888:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787574664.545695:0:17887:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787574664.545751:0:17887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17887:1874407346886016:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787574664.545786:0:17887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.545809:0:17887:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50627db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574664.545835:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346886016 00000100:00100000:0.0:1787574664.545841:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346886016 00000100:00100000:0.0:1787574664.545886:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787574664.545894:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17887:x1874407346886016:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787574664.545942:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17887:x1874407346886016:12345-0@lo:900:osp-pre-1-1.0 Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574664.545949:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787574664.545980:0:17887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40403a300 x1874407346886016/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787574680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574664.545991:0:17887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17887:1874407346886016:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1787574664.548680:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787574664.549570:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574664.549591:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6bfba79/0xd18a1efeeddb948a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.549608:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1787574664.549612:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574664.549618:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6bfba79/0xd18a1efeeddb948a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.549631:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6bfba79/0xd18a1efeeddb948a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.549640:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6bfba79/0xd18a1efeeddb948a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.549647:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6bfba79/0xd18a1efeeddb948a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.549659:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787574664.549997:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787574664.550007:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e67ed696/0xd18a1efeeddb947c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550016:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.550020:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e67ed696/0xd18a1efeeddb947c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550029:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e67ed696/0xd18a1efeeddb947c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550066:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e67ed696/0xd18a1efeeddb947c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550073:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e67ed696/0xd18a1efeeddb947c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550093:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574664.550097:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009abe90b5/0xd18a1efeeddb9483 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550103:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabe00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.550106:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009abe90b5/0xd18a1efeeddb9483 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550124:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009abe90b5/0xd18a1efeeddb9483 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550133:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009abe90b5/0xd18a1efeeddb9483 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550144:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009abe90b5/0xd18a1efeeddb9483 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550158:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574664.550161:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6bfba79/0xd18a1efeeddb948a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550173:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.550177:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6bfba79/0xd18a1efeeddb948a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550184:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6bfba79/0xd18a1efeeddb948a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550194:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6bfba79/0xd18a1efeeddb948a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550202:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6bfba79/0xd18a1efeeddb948a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.550215:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.550372:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.550376:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.550449:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574664.552679:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574664.552694:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000122e1fe7/0xd18a1efeeddb9491 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.552718:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1787574664.552722:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574664.552729:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000122e1fe7/0xd18a1efeeddb9491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.552744:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000122e1fe7/0xd18a1efeeddb9491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.552755:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000122e1fe7/0xd18a1efeeddb9491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.552763:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000122e1fe7/0xd18a1efeeddb9491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.552778:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574664.553050:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574664.553057:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000122e1fe7/0xd18a1efeeddb9491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.553065:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.553069:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000122e1fe7/0xd18a1efeeddb9491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.553077:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000122e1fe7/0xd18a1efeeddb9491 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.553101:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000122e1fe7/0xd18a1efeeddb9491 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.553109:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000122e1fe7/0xd18a1efeeddb9491 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.553141:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.553143:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.553145:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574664.553717:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574664.553726:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaa4cd69/0xd18a1efeeddb9498 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.553736:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1787574664.553740:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574664.553745:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaa4cd69/0xd18a1efeeddb9498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.553755:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaa4cd69/0xd18a1efeeddb9498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.553777:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaa4cd69/0xd18a1efeeddb9498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.553785:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaa4cd69/0xd18a1efeeddb9498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.553802:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574664.553812:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574664.553817:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaa4cd69/0xd18a1efeeddb9498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.553824:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574664.553827:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaa4cd69/0xd18a1efeeddb9498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.553835:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaa4cd69/0xd18a1efeeddb9498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.553847:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaa4cd69/0xd18a1efeeddb9498 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.553854:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaa4cd69/0xd18a1efeeddb9498 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.553867:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.553875:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.553877:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574664.555554:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574664.555566:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb949f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.555590:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1787574664.555594:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574664.555599:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb949f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.555610:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb949f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.555618:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb949f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.555624:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb949f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.555649:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574664.556051:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574664.556059:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb949f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.556068:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.556073:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb949f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.556081:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb949f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.556097:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb949f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.556103:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb949f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.556146:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.556148:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.556150:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.565293:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574664.569403:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.569417:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb94a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.569434:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.569439:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.569445:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb94a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.569458:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb94a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.569468:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb94a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.569474:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb94a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.569704:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574664.570568:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574664.570588:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb94a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574664.570600:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574664.570613:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb94a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574664.570623:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb94a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574664.570642:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb94a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574664.570649:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b43275e/0xd18a1efeeddb94a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574664.570668:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574664.570670:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574664.570671:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574664.571717:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.571729:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb94ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.571744:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.571748:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.571755:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb94ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.571768:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb94ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.571777:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb94ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.571785:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb94ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.571799:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787574664.573339:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.573352:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051b061ba/0xd18a1efeeddb94b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.573365:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.573376:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.573381:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051b061ba/0xd18a1efeeddb94b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.573394:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051b061ba/0xd18a1efeeddb94b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.573404:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051b061ba/0xd18a1efeeddb94b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.573412:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051b061ba/0xd18a1efeeddb94b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.573434:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787574664.573724:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574664.573733:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb94ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.573742:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.573747:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb94ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.573757:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb94ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.573776:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb94ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.573784:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fcd9cf3/0xd18a1efeeddb94ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.573806:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574664.573810:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051b061ba/0xd18a1efeeddb94b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.573817:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574664.573827:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051b061ba/0xd18a1efeeddb94b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.573835:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051b061ba/0xd18a1efeeddb94b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.573846:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051b061ba/0xd18a1efeeddb94b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.573853:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051b061ba/0xd18a1efeeddb94b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574664.573867:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.573869:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.573870:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.582315:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574664.582630:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.582641:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb94bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.582660:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.582664:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.582671:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb94bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.582686:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb94bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.582695:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb94bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.582712:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb94bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.582738:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787574664.583169:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574664.583175:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb94c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583185:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=603s v=(0 0) 00010000:00010000:0.0:1787574664.583188:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574664.583191:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb94c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583199:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb94c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583205:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb94c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583212:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb94c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583225:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787574664.583233:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574664.583256:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb94bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583270:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574664.583275:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb94bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583283:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb94bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583301:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb94bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583308:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b700e73a/0xd18a1efeeddb94bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583328:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574664.583331:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb94c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583340:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574664.583344:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb94c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583351:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb94c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583360:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb94c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583374:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033b157ee/0xd18a1efeeddb94c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574664.583388:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.583389:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574664.583391:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574664.586463:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787574664.592815:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787574664.592832:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf2dd82/0xd18a1efeeddb94c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574664.592852:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=603s v=(0 0) 00010000:00010000:1.0:1787574664.592857:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574664.592864:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cf2dd82/0xd18a1efeeddb94c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574664.592878:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cf2dd82/0xd18a1efeeddb94c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574664.592889:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf2dd82/0xd18a1efeeddb94c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574664.592912:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cf2dd82/0xd18a1efeeddb94c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574664.592942:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787574664.593032:0:18933:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1787574664.593146:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17170:x1874407346885376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 149982us (151904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574664.593156:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787574664.593288:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574664.593296:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cf2dd82/0xd18a1efeeddb94c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.593304:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574664.593309:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf2dd82/0xd18a1efeeddb94c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.593330:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf2dd82/0xd18a1efeeddb94c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.593347:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cf2dd82/0xd18a1efeeddb94c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.593355:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cf2dd82/0xd18a1efeeddb94c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574664.593374:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.593376:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574664.593378:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574664.593502:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034df100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1874407346885376:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787574664.593518:0:17170:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1787574664.593563:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40403a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1874407346886144:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787574664.593613:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574664.593642:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50627d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787574664.593745:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346886144 00000100:00100000:2.0:1787574664.593752:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346886144 00000100:00100000:2.0:1787574664.593800:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787574664.593810:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17170:x1874407346886144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787574664.593846:0:18652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1787574664.598255:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17170:x1874407346886144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4425us (4620us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787574664.598269:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787574664.598626:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40403a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1874407346886144:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787574664.598645:0:17170:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:1.0:1787574664.818105:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787574665.587500:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787574666.022097:0:19821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787574666.614827:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574667.003959:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574667.003982:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346886272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574667.004114:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574667.004165:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346886272 00000100:00100000:0.0:1787574667.004173:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346886272 00000100:00100000:0.0:1787574667.004227:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574667.005656:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346886272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574667.005697:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787574667.005777:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346886272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1541us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574667.005797:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787574667.005991:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574667.006088:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346886272:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1787574667.101137:0:19874:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574667.102598:0:19874:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574667.643512:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574668.020200:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574668.020233:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346886400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574668.021984:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574668.022196:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346886400 00000100:00100000:0.0:1787574668.022218:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346886400 00000100:00080000:3.0:1787574668.022335:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574668.022379:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574668.022393:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346886400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574668.022605:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787574668.022705:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346886400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 315us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574668.022715:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574668.022770:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346886400:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1787574668.444043:0:19924:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787574668.444361:0:19924:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574668.658623:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574668.847091:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574668.847292:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323719808 00000100:00100000:1.0:1787574668.847303:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323719808 00000100:00100000:1.0:1787574668.847355:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:1.0:1787574668.847364:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1874407323719808:12345-192.168.202.40@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787574668.847393:0:17137:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9ab24719-8af9-48f9-8992-e0214b678d6f@192.168.202.40@tcp t0 exp 0000000000000000 cur 608 last 0 00000020:00000080:1.0:1787574668.847424:0:17137:0:(genops.c:1385:class_connect()) connect: client 9ab24719-8af9-48f9-8992-e0214b678d6f, cookie 0xd18a1efeeddb94d0 00000100:00080000:1.0:1787574668.847591:0:17137:0:(import.c:65:import_set_state_nolock()) ffff9ca510a58000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574668.847667:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+5:2401:x1874407323719808:12345-192.168.202.40@tcp:250:mount.lustre.0 Request processed in 302us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574668.847674:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:0.0:1787574668.852182:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574668.853957:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323719936 00000100:00100000:2.0:1787574668.853972:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323719936 00000100:00100000:2.0:1787574668.854051:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:2.0:1787574668.854061:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+5:14929:x1874407323719936:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787574668.854085:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574668.854104:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb94d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9ba33 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574668.854132:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb94d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba33 expref: 6 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574668.854142:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb94d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba33 expref: 6 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574668.854151:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82e00, rc 0) 00000100:00100000:2.0:1787574668.854464:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+6:14929:x1874407323719936:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 403us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574668.854472:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:2.0:1787574668.868561:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574668.868816:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323720064 00000100:00100000:1.0:1787574668.868826:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323720064 00000100:00100000:1.0:1787574668.868932:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:1.0:1787574668.868943:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+6:14929:x1874407323720064:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787574668.869081:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+6:14929:x1874407323720064:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 138us (528us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787574668.869104:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:3.0:1787574668.878056:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574668.878272:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323720192 00000100:00100000:2.0:1787574668.878281:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323720192 00000100:00100000:2.0:1787574668.878329:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:2.0:1787574668.878337:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+6:14929:x1874407323720192:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787574668.878350:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574668.878364:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb94de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9ba3a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574668.878385:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb94de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba3a expref: 7 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574668.878399:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb94de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba3a expref: 7 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574668.878408:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83c00, rc 0) 00000100:00100000:2.0:1787574668.878465:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+7:14929:x1874407323720192:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 128us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574668.878471:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:2.0:1787574668.880412:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574668.880556:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323720320 00000100:00100000:1.0:1787574668.880567:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323720320 00000100:00100000:1.0:1787574668.880627:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:1.0:1787574668.880636:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+7:14929:x1874407323720320:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787574668.880803:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+8:14929:x1874407323720320:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 167us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574668.880811:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:3.0:1787574668.887022:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574668.887141:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323720448 00000100:00100000:0.0:1787574668.887153:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323720448 00000100:00100000:0.0:1787574668.887238:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:0.0:1787574668.887290:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+8:14929:x1874407323720448:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787574668.887431:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+8:14929:x1874407323720448:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 144us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574668.887440:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:0.0:1787574668.894792:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574668.895921:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323720576 00000100:00100000:3.0:1787574668.895935:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323720576 00000100:00100000:3.0:1787574668.896004:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:3.0:1787574668.896016:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+8:14948:x1874407323720576:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574668.896573:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+8:14948:x1874407323720576:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 557us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574668.896582:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:2.0:1787574668.940356:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574668.940459:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323720704 00000100:00100000:1.0:1787574668.940469:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323720704 00000100:00100000:1.0:1787574668.940520:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:1.0:1787574668.940530:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+8:14948:x1874407323720704:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574668.940828:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+8:14948:x1874407323720704:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 298us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574668.940836:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:2.0:1787574668.950790:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574668.951206:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323720832 00000100:00100000:0.0:1787574668.951217:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323720832 00000100:00100000:0.0:1787574668.951308:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:0.0:1787574668.951319:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+8:14948:x1874407323720832:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574668.951483:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+8:14948:x1874407323720832:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 165us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574668.951493:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:0.0:1787574668.961834:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574668.961967:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323720960 00000100:00100000:1.0:1787574668.961976:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323720960 00000100:00100000:1.0:1787574668.962038:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:1.0:1787574668.962049:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+8:14929:x1874407323720960:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787574668.962066:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574668.962084:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be75e00/0xd18a1efeeddb94e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9ba6b expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574668.962111:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be75e00/0xd18a1efeeddb94e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba6b expref: 9 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574668.962142:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be75e00/0xd18a1efeeddb94e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba6b expref: 9 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574668.962151:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75e00, rc 0) 00000100:00100000:1.0:1787574668.962223:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+9:14929:x1874407323720960:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 175us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574668.962230:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:2.0:1787574668.964827:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574668.964904:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323721088 00000100:00100000:3.0:1787574668.964913:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323721088 00000100:00100000:3.0:1787574668.964963:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:3.0:1787574668.964972:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+9:14929:x1874407323721088:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787574668.964999:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787574668.965022:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787574668.965026:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787574668.965039:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787574668.965042:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787574668.965045:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1787574668.967151:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+9:14929:x1874407323721088:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 2171us (2325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574668.967163:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:2.0:1787574668.971206:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574668.971378:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323721216 00000100:00100000:1.0:1787574668.971387:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323721216 00000100:00100000:1.0:1787574668.971444:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:1.0:1787574668.971463:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca526766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+9:14929:x1874407323721216:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787574668.971479:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574668.971495:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb94ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9ba72 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574668.971521:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb94ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba72 expref: 10 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574668.971533:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb94ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba72 expref: 10 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574668.971553:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74c00, rc 0) 00000100:00100000:1.0:1787574668.971606:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca526766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+10:14929:x1874407323721216:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 146us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574668.971613:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:2.0:1787574668.974275:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574668.976356:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323721344 00000100:00100000:3.0:1787574668.976372:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323721344 00000100:00100000:3.0:1787574668.976439:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:3.0:1787574668.976458:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+10:14929:x1874407323721344:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787574668.976634:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+10:14929:x1874407323721344:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 186us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574668.976662:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:2.0:1787574668.978983:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574668.979189:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323721472 00000100:00100000:0.0:1787574668.979199:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323721472 00000100:00100000:0.0:1787574668.979281:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:0.0:1787574668.979292:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+10:14929:x1874407323721472:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787574668.979429:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+10:14929:x1874407323721472:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 138us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574668.979437:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:2.0:1787574668.985277:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574668.985598:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323721600 00000100:00100000:0.0:1787574668.985610:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323721600 00000100:00100000:0.0:1787574668.985667:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:0.0:1787574668.985679:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+10:14950:x1874407323721600:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574668.985836:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+10:14950:x1874407323721600:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 158us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574668.985844:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:2.0:1787574668.992355:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574668.992483:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323721728 00000100:00100000:1.0:1787574668.992503:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323721728 00000100:00100000:1.0:1787574668.992568:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:1.0:1787574668.992579:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+10:14950:x1874407323721728:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574668.992735:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+10:14950:x1874407323721728:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 156us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574668.992742:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:2.0:1787574669.007650:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574669.011919:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323721856 00000100:00100000:0.0:1787574669.011935:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323721856 00000100:00100000:0.0:1787574669.011997:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1787574669.012007:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874407323721856:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787574669.012039:0:17142:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1d414e73-1942-4e41-ad1c-8720ad754d4d@192.168.202.40@tcp t0 exp 0000000000000000 cur 608 last 0 00000020:00000080:0.0:1787574669.012088:0:17142:0:(genops.c:1385:class_connect()) connect: client 1d414e73-1942-4e41-ad1c-8720ad754d4d, cookie 0xd18a1efeeddb94f3 00000004:00100000:0.0:1787574669.012111:0:17142:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787574669.012376:0:17142:0:(import.c:65:import_set_state_nolock()) ffff9ca40442c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574669.012438:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:2401:x1874407323721856:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 432us (4799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574669.012473:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1787574669.013974:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574669.014212:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323722112 00000100:00100000:0.0:1787574669.014220:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323722112 00000100:00100000:0.0:1787574669.014290:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1787574669.014298:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874407323722112:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787574669.014326:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1d414e73-1942-4e41-ad1c-8720ad754d4d@192.168.202.40@tcp t0 exp 0000000000000000 cur 608 last 0 00000020:00000080:0.0:1787574669.014387:0:17144:0:(genops.c:1385:class_connect()) connect: client 1d414e73-1942-4e41-ad1c-8720ad754d4d, cookie 0xd18a1efeeddb94fa 00000004:00100000:0.0:1787574669.014410:0:17144:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787574669.014609:0:17144:0:(import.c:65:import_set_state_nolock()) ffff9ca404429000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574669.014777:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:2401:x1874407323722112:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 477us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574669.014786:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:2.0:1787574669.025290:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574669.025493:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323722368 00000100:00100000:3.0:1787574669.025503:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323722368 00000100:00100000:3.0:1787574669.025592:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1787574669.025606:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:14929:x1874407323722368:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787574669.025649:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787574669.025744:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:14929:x1874407323722368:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 141us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574669.025753:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00080000:1.0:1787574669.025831:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574669.035484:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574669.035676:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323722240 00000100:00100000:2.0:1787574669.035685:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323722240 00000100:00100000:2.0:1787574669.035758:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1787574669.035769:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:0:x1874407323722240:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574669.035809:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574669.035926:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:0:x1874407323722240:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 157us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.035951:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00080000:1.0:1787574669.036289:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787574669.040715:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574669.040813:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323721984 00000100:00100000:0.0:1787574669.040824:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323721984 00000100:00100000:0.0:1787574669.040884:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:0.0:1787574669.040894:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:0:x1874407323721984:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787574669.040924:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787574669.040996:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:0:x1874407323721984:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 103us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574669.041003:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000040:00080000:2.0:1787574669.042166:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574669.043429:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346886528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574669.043530:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574669.043707:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346886528 00000100:00100000:0.0:1787574669.043715:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346886528 00000100:00100000:0.0:1787574669.043764:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787574669.043774:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346886528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574669.043799:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787574669.043857:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346886528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574669.043864:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787574669.043952:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346886528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574669.044147:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574669.044156:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346886656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574669.044184:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574669.044257:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346886656 00000100:00100000:0.0:1787574669.044263:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346886656 00000100:00100000:0.0:1787574669.044297:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787574669.044304:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346886656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574669.044316:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787574669.044357:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346886656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574669.044363:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787574669.044573:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346886656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574669.045874:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574669.045954:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323722496 00000100:00100000:3.0:1787574669.045961:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323722496 00000100:00100000:3.0:1787574669.046013:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1787574669.046023:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:14929:x1874407323722496:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787574669.046115:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:14929:x1874407323722496:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574669.046122:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1787574669.052974:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574669.053023:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574669.053075:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574669.053190:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323722624 00000100:00100000:1.0:1787574669.053201:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323722624 00000100:00100000:1.0:1787574669.053272:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323722752 00000100:00100000:1.0:1787574669.053275:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323722752 00000100:00100000:1.0:1787574669.053294:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:1.0:1787574669.053304:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874407323722624:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787574669.053335:0:18650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1d414e73-1942-4e41-ad1c-8720ad754d4d@192.168.202.40@tcp t0 exp 0000000000000000 cur 608 last 0 00000020:00000080:1.0:1787574669.053362:0:18650:0:(genops.c:1385:class_connect()) connect: client 1d414e73-1942-4e41-ad1c-8720ad754d4d, cookie 0xd18a1efeeddb9501 00002000:00100000:1.0:1787574669.053374:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1d414e73-1942-4e41-ad1c-8720ad754d4d/ffff9ca510a5d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787574669.053392:0:18650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787574669.053546:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1787574669.053553:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874407323722752:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787574669.053569:0:18651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1d414e73-1942-4e41-ad1c-8720ad754d4d@192.168.202.40@tcp t0 exp 0000000000000000 cur 608 last 0 00000020:00000080:3.0:1787574669.053584:0:18651:0:(genops.c:1385:class_connect()) connect: client 1d414e73-1942-4e41-ad1c-8720ad754d4d, cookie 0xd18a1efeeddb9508 00002000:00100000:3.0:1787574669.053604:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1d414e73-1942-4e41-ad1c-8720ad754d4d/ffff9ca4030fd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787574669.053614:0:18651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787574669.053747:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787574669.053780:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9ca4030fb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574669.053843:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:2401:x1874407323722752:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 289us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574669.053850:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00002000:00080000:1.0:1787574669.053974:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787574669.053992:0:18650:0:(import.c:65:import_set_state_nolock()) ffff9ca510a5a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574669.054013:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:2401:x1874407323722624:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 710us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574669.054019:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1787574669.054159:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323722880 00000100:00100000:0.0:1787574669.054165:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323722880 00000100:00100000:0.0:1787574669.054212:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:0.0:1787574669.054219:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:14929:x1874407323722880:12345-192.168.202.40@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787574669.054279:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:14929:x1874407323722880:12345-192.168.202.40@tcp:900:mount.lustre.0 Request processed in 60us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574669.054286:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:2.0:1787574669.059819:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574669.059945:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323723008 00000100:00100000:1.0:1787574669.059955:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323723008 00000100:00100000:1.0:1787574669.060015:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:1.0:1787574669.060026:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:14929:x1874407323723008:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787574669.069410:0:17146:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9278us 00000004:00200000:2.0:1787574669.088124:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787574669.088365:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:14929:x1874407323723008:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 28333us (28548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.088381:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1787574669.342684:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574669.342803:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323723136 00000100:00100000:2.0:1787574669.342813:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323723136 00000100:00100000:2.0:1787574669.342886:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:2.0:1787574669.342899:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:14973:x1874407323723136:12345-192.168.202.40@tcp:101:mkdir.0 00010000:00010000:2.0:1787574669.342923:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574669.342956:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82800/0xd18a1efeeddb950f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9baa3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574669.343023:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83e00/0xd18a1efeeddb9516 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574669.343036:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83e00/0xd18a1efeeddb9516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574669.343050:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83e00/0xd18a1efeeddb9516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574669.343105:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787574669.343124:0:17142:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574669.343161:0:17142:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83e00/0xd18a1efeeddb9516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574669.343186:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82800/0xd18a1efeeddb950f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9baa3 expref: 8 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574669.343205:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83e00/0xd18a1efeeddb9516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9baa3 expref: 7 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574669.343215:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca52057de00) 00010000:00010000:2.0:1787574669.343218:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574669.343221:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83e00, rc 0) 00000100:00100000:2.0:1787574669.343334:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:14973:x1874407323723136:12345-192.168.202.40@tcp:101:mkdir.0 Request processed in 438us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.343340:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1787574669.553508:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574669.553543:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346886784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574669.553646:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574669.553698:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346886784 00000100:00100000:0.0:1787574669.553705:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346886784 00000100:00100000:0.0:1787574669.553756:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574669.553765:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346886784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574669.553801:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787574669.553844:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346886784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574669.553851:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574669.553897:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346886784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574669.554228:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346886912:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554300:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574669.554326:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346887424:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554351:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574669.554366:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346887936:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554392:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574669.554408:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787574669.554413:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346887296:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554432:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574669.554460:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346887808:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554479:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574669.554521:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346887040:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554557:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574669.554574:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346887552:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554591:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574669.554600:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346888064:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554618:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574669.554628:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787574669.554633:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346887168:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554656:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574669.554671:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346887680:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554690:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574669.554710:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346887424 00000100:00100000:2.0:1787574669.554714:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346887424 00000100:00100000:2.0:1787574669.554742:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346887040 00000100:00100000:2.0:1787574669.554745:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346887040 00000100:00100000:2.0:1787574669.554762:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346887168 00000100:00100000:2.0:1787574669.554764:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346887168 00000100:00100000:2.0:1787574669.554778:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574669.554785:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346887424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554826:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346887424:12345-0@lo:400:kworker.0 Request processed in 41us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.554832:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574669.554845:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574669.554851:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346887040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554881:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346887040:12345-0@lo:400:kworker.0 Request processed in 31us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.554887:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574669.554908:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787574669.554914:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346887168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554937:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346887168:12345-0@lo:400:kworker.0 Request processed in 24us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.554943:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787574669.554972:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346887424:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.554996:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346887168:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.555006:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346887040:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.555027:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346887936 00000100:00100000:2.0:1787574669.555030:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346887936 00000100:00100000:2.0:1787574669.555049:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346887296 00000100:00100000:2.0:1787574669.555052:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346887296 00000100:00100000:2.0:1787574669.555062:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346887808 00000100:00100000:2.0:1787574669.555064:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346887808 00000100:00100000:2.0:1787574669.555075:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346887552 00000100:00100000:2.0:1787574669.555077:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346887552 00000100:00100000:2.0:1787574669.555087:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346888064 00000100:00100000:2.0:1787574669.555089:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346888064 00000100:00100000:2.0:1787574669.555099:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346887680 00000100:00100000:2.0:1787574669.555102:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346887680 00000100:00100000:2.0:1787574669.555114:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787574669.555120:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346887936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.555151:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346887936:12345-0@lo:400:kworker.0 Request processed in 31us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.555157:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787574669.555168:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787574669.555173:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346887296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.555209:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346887296:12345-0@lo:400:kworker.0 Request processed in 36us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.555215:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787574669.555226:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787574669.555231:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346887808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.555285:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346887808:12345-0@lo:400:kworker.0 Request processed in 53us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.555291:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787574669.555301:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787574669.555306:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346887552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.555332:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346887552:12345-0@lo:400:kworker.0 Request processed in 26us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.555338:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787574669.555348:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787574669.555354:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346888064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.555377:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346888064:12345-0@lo:400:kworker.0 Request processed in 25us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.555383:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787574669.555392:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574669.555398:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346887680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.555418:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346887680:12345-0@lo:400:kworker.0 Request processed in 21us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574669.555422:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574669.555450:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346887296:0@lo:400:kworker.0 00010000:00080000:2.0:1787574669.555474:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4040bfb80 x1874407346887808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574669.555485:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346887808:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.555496:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346887936:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.555523:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346887680:0@lo:400:kworker.0 00000100:00100000:2.0:1787574669.555546:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346887552:0@lo:400:kworker.0 00010000:00080000:2.0:1787574669.555556:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4040bf100 x1874407346888064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574669.555565:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346888064:0@lo:400:kworker.0 00000100:00100000:3.0:1787574669.555886:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346886912 00000100:00100000:3.0:1787574669.555892:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346886912 00000100:00100000:3.0:1787574669.555937:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787574669.555945:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3637:x1874407346886912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574669.555987:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3637:x1874407346886912:12345-0@lo:400:kworker.0 Request processed in 43us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574669.555993:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787574669.556046:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346886912:0@lo:400:kworker.0 00000100:00080000:1.0:1787574669.556396:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574669.556403:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574669.556407:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574669.556410:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574669.556475:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346888192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574669.556511:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574669.556665:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346888192 00000100:00100000:1.0:1787574669.556670:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346888192 00000100:00100000:1.0:1787574669.556711:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574669.556719:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346888192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574669.556736:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787574669.556782:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346888192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574669.556788:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574669.556825:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346888192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787574669.685932:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787574670.598731:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1d414e73-1942-4e41-ad1c-8720ad754d4d 00000001:00080000:2.0:1787574670.598747:0:19464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:3.0:1787574670.706580:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574671.730844:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574671.785049:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574671.785266:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323723264 00000100:00100000:0.0:1787574671.785275:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323723264 00000100:00080000:1.0:1787574671.785444:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574671.785501:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1787574671.785523:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:15025:x1874407323723264:12345-192.168.202.40@tcp:41:lfs.0 00000004:00000024:0.0:1787574671.785560:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787574671.785644:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:15025:x1874407323723264:12345-192.168.202.40@tcp:41:lfs.0 Request processed in 134us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574671.785650:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1787574671.802008:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574671.802158:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323723392 00000100:00100000:2.0:1787574671.802168:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323723392 00000100:00080000:1.0:1787574671.802266:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787574671.802275:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1787574671.802287:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:15025:x1874407323723392:12345-192.168.202.40@tcp:41:lfs.0 00000004:00000024:2.0:1787574671.802325:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574671.802407:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:15025:x1874407323723392:12345-192.168.202.40@tcp:41:lfs.0 Request processed in 122us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574671.802415:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:1.0:1787574671.808181:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574671.808627:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323723520 00000100:00100000:0.0:1787574671.808638:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323723520 00000100:00100000:0.0:1787574671.808748:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1787574671.808759:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:15025:x1874407323723520:12345-192.168.202.40@tcp:13:lfs.0 00002000:00000024:0.0:1787574671.808793:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787574671.808903:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:15025:x1874407323723520:12345-192.168.202.40@tcp:13:lfs.0 Request processed in 144us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574671.808910:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00080000:1.0:1787574671.809610:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574671.818753:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574671.818931:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323723648 00000100:00100000:1.0:1787574671.819193:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323723648 00000100:00100000:1.0:1787574671.819391:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:1.0:1787574671.819404:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:15025:x1874407323723648:12345-192.168.202.40@tcp:13:lfs.0 00002000:00000024:1.0:1787574671.819455:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787574671.819584:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:15025:x1874407323723648:12345-192.168.202.40@tcp:13:lfs.0 Request processed in 181us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574671.819594:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00080000:2.0:1787574671.824167:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574672.113991:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346888320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574672.114067:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574672.114695:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346888320 00000100:00100000:1.0:1787574672.114706:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346888320 00000100:00100000:1.0:1787574672.114791:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787574672.114802:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346888320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574672.114825:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787574672.114905:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346888320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574672.114912:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787574672.114991:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574672.116305:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346888320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574672.181135:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574672.181285:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323723776 00000100:00100000:0.0:1787574672.181301:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323723776 00000100:00100000:0.0:1787574672.181444:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:0.0:1787574672.181456:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+10:15057:x1874407323723776:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787574672.181472:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574672.181488:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca500030000/0xd18a1efeeddb951d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9baaa expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574672.181545:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500030000/0xd18a1efeeddb951d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9baaa expref: 11 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574672.181556:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca500030000/0xd18a1efeeddb951d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9baaa expref: 11 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574672.181565:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030000, rc 0) 00000100:00100000:0.0:1787574672.181628:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15057:x1874407323723776:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 174us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574672.181635:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:0.0:1787574672.194277:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574672.194368:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323723904 00000100:00100000:2.0:1787574672.194378:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323723904 00000100:00100000:2.0:1787574672.194441:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:2.0:1787574672.194452:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15057:x1874407323723904:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787574672.194633:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15057:x1874407323723904:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 182us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.194641:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:2.0:1787574672.228171:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574672.228767:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323724032 00000100:00100000:3.0:1787574672.228778:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323724032 00000100:00100000:3.0:1787574672.228841:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:3.0:1787574672.228852:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15057:x1874407323724032:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787574672.229034:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15057:x1874407323724032:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 183us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574672.229043:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:3.0:1787574672.235087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574672.235294:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323724160 00000100:00100000:0.0:1787574672.235305:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323724160 00000100:00100000:0.0:1787574672.235367:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:0.0:1787574672.235378:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15064:x1874407323724160:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574672.235576:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15064:x1874407323724160:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 199us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574672.235584:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:0.0:1787574672.309442:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574672.309727:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323724288 00000100:00100000:2.0:1787574672.309739:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323724288 00000100:00100000:2.0:1787574672.309843:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:2.0:1787574672.309853:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15064:x1874407323724288:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574672.310042:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15064:x1874407323724288:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 189us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.310050:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:2.0:1787574672.322428:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574672.322538:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323724416 00000100:00100000:3.0:1787574672.322549:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323724416 00000100:00100000:3.0:1787574672.322609:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:3.0:1787574672.322619:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15064:x1874407323724416:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787574672.322800:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15064:x1874407323724416:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 181us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574672.322808:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:3.0:1787574672.330902:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574672.331149:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323724544 00000100:00100000:2.0:1787574672.331161:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323724544 00000100:00100000:2.0:1787574672.331224:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:2.0:1787574672.331236:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+11:15057:x1874407323724544:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787574672.331268:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574672.331300:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb9524 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9badb expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574672.331332:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb9524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9badb expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574672.331367:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb9524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9badb expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574672.331377:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83600, rc 0) 00000100:00100000:2.0:1787574672.331443:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+12:15057:x1874407323724544:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 209us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.331449:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:1.0:1787574672.340884:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574672.342416:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323724672 00000100:00100000:0.0:1787574672.342447:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323724672 00000100:00100000:0.0:1787574672.342583:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:0.0:1787574672.342594:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4036ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+12:15057:x1874407323724672:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787574672.342618:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787574672.342634:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787574672.342638:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787574672.342641:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787574672.342644:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787574672.342646:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787574672.344714:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4036ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+12:15057:x1874407323724672:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 2110us (3828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.344729:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:2.0:1787574672.351410:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574672.351548:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323724800 00000100:00100000:1.0:1787574672.351559:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323724800 00000100:00100000:1.0:1787574672.351665:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:1.0:1787574672.351675:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+12:15057:x1874407323724800:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787574672.351693:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574672.351710:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb952b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bae2 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574672.351739:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb952b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bae2 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574672.351771:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb952b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bae2 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574672.351780:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74000, rc 0) 00000100:00100000:1.0:1787574672.351848:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+13:15057:x1874407323724800:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 174us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574672.351855:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:1.0:1787574672.355434:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574672.355627:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323724928 00000100:00100000:2.0:1787574672.355637:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323724928 00000100:00100000:2.0:1787574672.355733:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:2.0:1787574672.355744:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+13:15057:x1874407323724928:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787574672.355904:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+13:15057:x1874407323724928:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 159us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.355911:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:0.0:1787574672.362360:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574672.362457:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323725056 00000100:00100000:1.0:1787574672.362466:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323725056 00000100:00100000:1.0:1787574672.362523:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:1.0:1787574672.362535:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+13:15057:x1874407323725056:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787574672.362733:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+13:15057:x1874407323725056:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 200us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574672.362741:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:0.0:1787574672.371461:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574672.371682:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323725184 00000100:00100000:2.0:1787574672.371692:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323725184 00000100:00100000:2.0:1787574672.373386:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:2.0:1787574672.373408:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+13:15066:x1874407323725184:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574672.373588:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+13:15066:x1874407323725184:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 190us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.373606:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:0.0:1787574672.382501:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574672.382754:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323725312 00000100:00100000:1.0:1787574672.382764:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323725312 00000100:00100000:1.0:1787574672.382831:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:1.0:1787574672.382842:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+13:15066:x1874407323725312:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574672.383026:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+13:15066:x1874407323725312:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 184us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574672.383035:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:0.0:1787574672.388101:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574672.388224:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323725440 00000100:00100000:2.0:1787574672.388235:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323725440 00000100:00100000:2.0:1787574672.388376:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1787574672.388385:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874407323725440:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787574672.388415:0:17142:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 26f06173-8373-497a-8777-dc305c5dce24@192.168.202.40@tcp t0 exp 0000000000000000 cur 611 last 0 00000020:00000080:2.0:1787574672.388454:0:17142:0:(genops.c:1385:class_connect()) connect: client 26f06173-8373-497a-8777-dc305c5dce24, cookie 0xd18a1efeeddb9532 00000004:00100000:2.0:1787574672.388481:0:17142:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787574672.388577:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00080000:2.0:1787574672.388709:0:17142:0:(import.c:65:import_set_state_nolock()) ffff9ca4035bd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574672.388802:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f06173-8373-497a-8777-dc305c5dce24+6:2401:x1874407323725440:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 416us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.388810:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1787574672.389353:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323725696 00000100:00100000:2.0:1787574672.389360:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323725696 00000100:00100000:2.0:1787574672.389396:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1787574672.389403:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874407323725696:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787574672.389421:0:17142:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 26f06173-8373-497a-8777-dc305c5dce24@192.168.202.40@tcp t0 exp 0000000000000000 cur 611 last 0 00000020:00000080:2.0:1787574672.389468:0:17142:0:(genops.c:1385:class_connect()) connect: client 26f06173-8373-497a-8777-dc305c5dce24, cookie 0xd18a1efeeddb9539 00000004:00100000:2.0:1787574672.389485:0:17142:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787574672.389551:0:17142:0:(import.c:65:import_set_state_nolock()) ffff9ca5109bd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574672.389611:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f06173-8373-497a-8777-dc305c5dce24+6:2401:x1874407323725696:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 206us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.389619:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1787574672.405233:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574672.405292:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574672.405333:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574672.405412:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323725568 00000100:00100000:2.0:1787574672.405422:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323725568 00000100:00100000:2.0:1787574672.405484:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323725952 00000100:00100000:2.0:1787574672.405487:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323725952 00000100:00100000:2.0:1787574672.405498:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323725824 00000100:00100000:2.0:1787574672.405500:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323725824 00000100:00100000:2.0:1787574672.405530:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:2.0:1787574672.405540:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f06173-8373-497a-8777-dc305c5dce24+7:0:x1874407323725568:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574672.405607:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787574672.405675:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f06173-8373-497a-8777-dc305c5dce24+7:0:x1874407323725568:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 135us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.405682:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:2.0:1787574672.405700:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:2.0:1787574672.405706:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f06173-8373-497a-8777-dc305c5dce24+6:15057:x1874407323725952:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574672.405717:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787574672.405737:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f06173-8373-497a-8777-dc305c5dce24+6:15057:x1874407323725952:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 32us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.405754:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:2.0:1787574672.405767:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:2.0:1787574672.405774:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f06173-8373-497a-8777-dc305c5dce24+6:0:x1874407323725824:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574672.405789:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574672.405812:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f06173-8373-497a-8777-dc305c5dce24+6:0:x1874407323725824:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 39us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.405818:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00080000:1.0:1787574672.407262:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574672.407271:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574672.418456:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574672.419226:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323726080 00000100:00100000:2.0:1787574672.419279:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323726080 00000100:00100000:2.0:1787574672.419404:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1787574672.419416:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f06173-8373-497a-8777-dc305c5dce24+6:15057:x1874407323726080:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787574672.419535:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f06173-8373-497a-8777-dc305c5dce24+6:15057:x1874407323726080:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 121us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574672.419543:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1787574672.432289:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574672.432321:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574672.432353:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574672.432377:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323726464 00000100:00100000:0.0:1787574672.432387:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323726464 00000100:00100000:0.0:1787574672.432439:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:0.0:1787574672.432448:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:26f06173-8373-497a-8777-dc305c5dce24+6:15057:x1874407323726464:12345-192.168.202.40@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787574672.432539:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:26f06173-8373-497a-8777-dc305c5dce24+6:15057:x1874407323726464:12345-192.168.202.40@tcp:900:mount.lustre.0 Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574672.432547:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1787574672.432990:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323726208 00000100:00100000:1.0:1787574672.432997:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323726208 00000100:00100000:1.0:1787574672.433028:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323726336 00000100:00100000:1.0:1787574672.433031:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323726336 00000100:00100000:1.0:1787574672.433049:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1787574672.433054:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874407323726208:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787574672.433083:0:18933:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 26f06173-8373-497a-8777-dc305c5dce24@192.168.202.40@tcp t0 exp 0000000000000000 cur 611 last 0 00000020:00000080:1.0:1787574672.433115:0:18933:0:(genops.c:1385:class_connect()) connect: client 26f06173-8373-497a-8777-dc305c5dce24, cookie 0xd18a1efeeddb9540 00002000:00100000:1.0:1787574672.433127:0:18933:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 26f06173-8373-497a-8777-dc305c5dce24/ffff9ca507da1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787574672.433139:0:18933:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787574672.433223:0:18933:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787574672.433278:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebeb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574672.433321:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26f06173-8373-497a-8777-dc305c5dce24+6:2401:x1874407323726208:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 264us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574672.433329:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1787574672.433344:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:1.0:1787574672.433348:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874407323726336:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787574672.433364:0:18933:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 26f06173-8373-497a-8777-dc305c5dce24@192.168.202.40@tcp t0 exp 0000000000000000 cur 611 last 0 00000020:00000080:1.0:1787574672.433382:0:18933:0:(genops.c:1385:class_connect()) connect: client 26f06173-8373-497a-8777-dc305c5dce24, cookie 0xd18a1efeeddb9547 00002000:00100000:1.0:1787574672.433387:0:18933:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 26f06173-8373-497a-8777-dc305c5dce24/ffff9ca53bc3c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787574672.433393:0:18933:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787574672.433451:0:18933:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787574672.433481:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9ca52e72b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574672.433517:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26f06173-8373-497a-8777-dc305c5dce24+6:2401:x1874407323726336:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 154us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574672.433524:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1787574672.455864:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574672.456108:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323726592 00000100:00100000:1.0:1787574672.456120:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323726592 00000100:00100000:1.0:1787574672.456191:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1787574672.456202:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26f06173-8373-497a-8777-dc305c5dce24+6:15057:x1874407323726592:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787574672.456394:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787574672.457188:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26f06173-8373-497a-8777-dc305c5dce24+6:15057:x1874407323726592:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 981us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574672.457200:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00010000:00010000:3.0:1787574672.755458:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574672.775071:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574672.775271:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323726720 00000100:00100000:0.0:1787574672.775282:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323726720 00000100:00100000:0.0:1787574672.775347:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1787574672.775370:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f06173-8373-497a-8777-dc305c5dce24+6:15090:x1874407323726720:12345-192.168.202.40@tcp:101:mkdir.0 00010000:00010000:0.0:1787574672.775390:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574672.775577:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb954e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb13 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574672.775655:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574672.775670:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574672.775683:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574672.775733:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574672.775738:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574672.775762:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574672.775789:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031e00/0xd18a1efeeddb954e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb13 expref: 8 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574672.775807:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb13 expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574672.775816:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca52057de00) 00010000:00010000:0.0:1787574672.775818:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574672.775822:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030800, rc 0) 00000100:00100000:0.0:1787574672.775890:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f06173-8373-497a-8777-dc305c5dce24+7:15090:x1874407323726720:12345-192.168.202.40@tcp:101:mkdir.0 Request processed in 521us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574672.775909:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1787574673.137717:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574673.137742:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346888448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574673.137814:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574673.138035:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346888448 00000100:00100000:1.0:1787574673.138044:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346888448 00000100:00100000:1.0:1787574673.138116:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787574673.138127:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346888448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787574673.138154:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787574673.138282:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346888448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574673.138289:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787574673.139042:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574673.140843:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346888448:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787574673.777791:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787574674.035047:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787574674.161611:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574674.161634:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346888576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574674.161704:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574674.161761:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346888576 00000100:00100000:3.0:1787574674.161769:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346888576 00000100:00100000:3.0:1787574674.161813:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787574674.161824:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346888576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574674.161855:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787574674.161916:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346888576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574674.161923:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787574674.161966:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346888576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574674.162214:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574674.162226:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346888704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574674.162365:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574674.162433:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346888704 00000100:00100000:2.0:1787574674.162438:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346888704 00000100:00100000:2.0:1787574674.162475:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787574674.162483:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346888704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574674.162513:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574674.162564:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346888704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574674.162571:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787574674.162601:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346888704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574674.681718:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346889216:0@lo:400:kworker.0 00000100:00100000:0.0:1787574674.681785:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574674.681816:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346889728:0@lo:400:kworker.0 00000100:00100000:0.0:1787574674.681837:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574674.681861:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787574674.681867:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346889088:0@lo:400:kworker.0 00000100:00100000:2.0:1787574674.681884:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346889216 00000100:00100000:2.0:1787574674.681892:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346889216 00000100:00100000:0.0:1787574674.681909:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574674.681929:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346889600:0@lo:400:kworker.0 00000100:00100000:2.0:1787574674.681935:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346889728 00000100:00100000:2.0:1787574674.681939:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346889728 00000100:00100000:0.0:1787574674.681949:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574674.681959:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346889600 00000100:00100000:0.0:1787574674.681959:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346890112:0@lo:400:kworker.0 00000100:00100000:2.0:1787574674.681961:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346889600 00000100:00100000:2.0:1787574674.681975:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787574674.681977:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574674.681983:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346889216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574674.681995:0:17144:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787574674.682001:0:17144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787574674.682018:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346889088 00000100:00100000:0.0:1787574674.682021:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346889088 00000100:00100000:2.0:1787574674.682036:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346889216:12345-0@lo:400:kworker.0 Request processed in 54us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574674.682043:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787574674.682048:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574674.682054:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346889088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574674.682056:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346890112 00000100:00100000:2.0:1787574674.682059:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346890112 00000100:00100000:2.0:1787574674.682073:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574674.682085:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346889728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574674.682097:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346889088:12345-0@lo:400:kworker.0 Request processed in 43us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574674.682104:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574674.682108:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346889728:12345-0@lo:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574674.682113:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574674.682124:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787574674.682129:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346889600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574674.682259:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346889600:12345-0@lo:400:kworker.0 Request processed in 128us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574674.682266:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787574674.682279:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787574674.682286:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346890112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.682297:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346888960:0@lo:400:kworker.0 00000100:00100000:2.0:1787574674.682313:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346890112:12345-0@lo:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574674.682319:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787574674.682330:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787574674.682337:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574674.682341:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574674.682344:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574674.682349:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346889472:0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.682369:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574674.682384:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346889984:0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.682405:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574674.682421:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787574674.682426:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346888832:0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.682453:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574674.682478:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346889344:0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.682509:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574674.682525:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346889856:0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.682550:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574674.682599:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346888960 00000100:00100000:1.0:1787574674.682603:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346888960 00000100:00100000:1.0:1787574674.682629:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346889472 00000100:00100000:1.0:1787574674.682632:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346889472 00000100:00100000:1.0:1787574674.682642:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346889344 00000100:00100000:1.0:1787574674.682644:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346889344 00000100:00100000:1.0:1787574674.682656:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574674.682661:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346888960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.682697:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346888960:12345-0@lo:400:kworker.0 Request processed in 35us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574674.682703:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574674.682714:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574674.682719:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346889472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.682741:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346889472:12345-0@lo:400:kworker.0 Request processed in 23us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574674.682754:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574674.682766:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574674.682772:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346889344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.682812:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346889344:12345-0@lo:400:kworker.0 Request processed in 40us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574674.682818:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574674.682869:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346889344:0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.682878:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346888960:0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.682885:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346889472:0@lo:400:kworker.0 00000100:00100000:0.0:1787574674.685905:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346889984 00000100:00100000:0.0:1787574674.685919:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346889984 00000100:00100000:0.0:1787574674.685966:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346889856 00000100:00100000:2.0:1787574674.685974:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787574674.685975:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346889856 00000100:00100000:2.0:1787574674.685984:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346889984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574674.685994:0:17144:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787574674.686001:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787574674.686007:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346889856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574674.686663:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787574674.686678:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346890368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574674.688373:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346889856:12345-0@lo:400:kworker.0 Request processed in 2357us (5813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574674.688386:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787574674.694817:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346889984:12345-0@lo:400:kworker.0 Request processed in 8824us (12399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574674.694832:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787574674.694889:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346888832 00000100:00100000:2.0:1787574674.694898:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346888832 00000100:00100000:2.0:1787574674.694944:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787574674.694953:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3637:x1874407346888832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574674.695026:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3637:x1874407346888832:12345-0@lo:400:kworker.0 Request processed in 75us (12572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574674.695032:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787574674.695067:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574674.695085:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346890240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574674.695119:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787574674.695228:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574674.695235:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574674.695254:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787574674.695258:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574674.695952:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346890240 00000100:00100000:2.0:1787574674.695959:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346890240 00000100:00100000:2.0:1787574674.696005:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574674.696014:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346890240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574674.696039:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787574674.696100:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346890240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574674.696106:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574674.696144:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1787574674.696587:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346889088:0@lo:400:kworker.0 00000001:00100000:0.0:1787574674.696948:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 26f06173-8373-497a-8777-dc305c5dce24 00000001:00100000:0.0:1787574674.696955:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1d414e73-1942-4e41-ad1c-8720ad754d4d 00000001:00100000:0.0:1787574674.697601:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 26f06173-8373-497a-8777-dc305c5dce24 00000001:00100000:0.0:1787574674.697608:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1d414e73-1942-4e41-ad1c-8720ad754d4d 00000100:00100000:3.0:1787574674.697769:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574674.698967:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346888832:0@lo:400:kworker.0 00010000:00080000:3.0:1787574674.698987:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5349fdf80 x1874407346889856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574674.698999:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346889856:0@lo:400:kworker.0 00000100:00100000:3.0:1787574674.699011:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346889984:0@lo:400:kworker.0 00000100:00100000:1.0:1787574674.699587:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346890240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574674.699612:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346890368 00000100:00100000:0.0:1787574674.699619:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346890368 00000100:00100000:0.0:1787574674.699675:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787574674.699685:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346890368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574674.699708:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787574674.699779:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346890368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574674.699787:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787574674.699823:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346890368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574674.703439:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346889600:0@lo:400:kworker.0 00010000:00080000:3.0:1787574674.703459:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5349ff800 x1874407346890112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574674.703470:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346890112:0@lo:400:kworker.0 00000100:00100000:3.0:1787574674.703494:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346889216:0@lo:400:kworker.0 00000100:00100000:3.0:1787574674.703507:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346889728:0@lo:400:kworker.0 00000001:00100000:0.0:1787574674.709924:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 26f06173-8373-497a-8777-dc305c5dce24 00000001:00100000:0.0:1787574674.709940:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1d414e73-1942-4e41-ad1c-8720ad754d4d 00010000:00010000:3.0:1787574674.802015:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574675.825392:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574676.213603:0:20023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787574676.852653:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574677.233481:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574677.233520:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346890496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574677.233594:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574677.234171:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346890496 00000100:00100000:0.0:1787574677.234180:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346890496 00000100:00100000:0.0:1787574677.234395:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787574677.234565:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346890496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574677.234597:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787574677.234663:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346890496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 258us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574677.234680:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574677.234781:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346890496:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787574677.234900:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787574677.785562:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 26f06173-8373-497a-8777-dc305c5dce24 00000100:00100000:3.0:1787574677.795155:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574677.795199:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574677.795261:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574677.795289:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574677.795307:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574677.795316:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323727104 00000100:00100000:3.0:1787574677.795325:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574677.795326:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323727104 00000100:00100000:3.0:1787574677.795346:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574677.795365:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574677.795380:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323727616 00000100:00100000:0.0:1787574677.795383:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323727616 00000100:00100000:3.0:1787574677.795389:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574677.795396:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323726976 00000100:00100000:0.0:1787574677.795399:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323726976 00000100:00100000:3.0:1787574677.795419:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323726848 00000100:00100000:3.0:1787574677.795422:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323726848 00000100:00100000:3.0:1787574677.795473:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:3.0:1787574677.795483:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2404:x1874407323726848:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574677.795563:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2404:x1874407323726848:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 81us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574677.795571:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:0.0:1787574677.795587:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323727488 00000100:00100000:0.0:1787574677.795591:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323727488 00000100:00100000:3.0:1787574677.795603:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:3.0:1787574677.795610:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2404:x1874407323727104:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574677.795645:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2404:x1874407323727104:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574677.806405:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:0.0:1787574677.806438:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f06173-8373-497a-8777-dc305c5dce24+5:2404:x1874407323727616:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574677.806535:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f06173-8373-497a-8777-dc305c5dce24+5:2404:x1874407323727616:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 117us (11245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574677.806543:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:0.0:1787574677.806573:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1787574677.806580:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:2404:x1874407323726976:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574677.806599:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:2404:x1874407323726976:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (11273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574677.806605:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1787574677.806614:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:0.0:1787574677.806620:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f06173-8373-497a-8777-dc305c5dce24+6:2404:x1874407323727488:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574677.806637:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f06173-8373-497a-8777-dc305c5dce24+6:2404:x1874407323727488:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 17us (11272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574677.806642:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00080000:0.0:1787574677.806663:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574677.806680:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574677.814823:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:3.0:1787574677.814892:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323727360 00000100:00100000:3.0:1787574677.814915:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323727360 00000100:00080000:0.0:1787574677.815173:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574677.826854:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323727872 00000100:00100000:3.0:1787574677.826869:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323727872 00000100:00100000:2.0:1787574677.827329:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323727232 00000100:00100000:2.0:1787574677.827336:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323727232 00000100:00100000:2.0:1787574677.827478:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323727744 00000100:00100000:2.0:1787574677.827483:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323727744 00000100:00100000:2.0:1787574677.827509:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:2.0:1787574677.827520:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2404:x1874407323727360:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574677.827615:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2404:x1874407323727360:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 97us (32354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574677.827624:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:2.0:1787574677.827640:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:2.0:1787574677.827647:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5416d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2404:x1874407323727232:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574677.827669:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5416d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2404:x1874407323727232:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (32322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574677.827675:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:2.0:1787574677.827686:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1787574677.827691:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f06173-8373-497a-8777-dc305c5dce24+5:2404:x1874407323727744:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574677.827711:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f06173-8373-497a-8777-dc305c5dce24+5:2404:x1874407323727744:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (32322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574677.827716:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:3.0:1787574677.828943:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1787574677.828958:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26f06173-8373-497a-8777-dc305c5dce24+5:2404:x1874407323727872:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574677.833635:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26f06173-8373-497a-8777-dc305c5dce24+5:2404:x1874407323727872:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 4669us (38313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574677.833650:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00080000:3.0:1787574677.834099:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574677.834105:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787574677.874476:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574678.264754:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574678.264778:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346890624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574678.264845:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574678.265506:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346890624 00000100:00100000:1.0:1787574678.265515:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346890624 00000100:00100000:1.0:1787574678.265577:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574678.265586:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346890624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787574678.265608:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787574678.265663:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346890624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574678.265674:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574678.265723:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346890624:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787574678.267548:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787574678.897405:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574679.286942:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574679.289458:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574679.289487:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346890752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574679.289561:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574679.289643:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346890752 00000100:00100000:1.0:1787574679.289651:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346890752 00000100:00100000:1.0:1787574679.289699:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787574679.289710:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346890752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787574679.289747:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787574679.289793:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346890752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574679.289800:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787574679.289844:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346890752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574679.293996:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574679.294020:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346890880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574679.294162:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574679.294282:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346890880 00000100:00100000:0.0:1787574679.294290:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346890880 00000100:00100000:0.0:1787574679.294338:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787574679.294348:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346890880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574679.294462:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787574679.294513:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346890880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574679.294521:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787574679.294608:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346890880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574679.793781:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346891008:0@lo:400:kworker.0 00000100:00100000:1.0:1787574679.793866:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574679.793951:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346891008 00000100:00100000:2.0:1787574679.793959:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346891008 00000100:00100000:2.0:1787574679.794008:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787574679.794018:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3637:x1874407346891008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574679.801738:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3637:x1874407346891008:12345-0@lo:400:kworker.0 Request processed in 7712us (7862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574679.801754:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787574679.802603:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346891008:0@lo:400:kworker.0 00000100:00100000:1.0:1787574679.802639:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346891520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574679.802696:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574679.802735:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346891520 00000100:00100000:1.0:1787574679.802741:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346891520 00000100:00100000:1.0:1787574679.802786:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787574679.802794:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346891520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574679.802820:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787574679.802854:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346891520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574679.802869:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787574679.802887:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574679.802913:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346891520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574679.802923:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574679.802929:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346891392:0@lo:400:kworker.0 00000100:00100000:1.0:1787574679.802952:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574679.802972:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346891392 00000100:00100000:1.0:1787574679.802975:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346891392 00000100:00100000:1.0:1787574679.802998:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787574679.803004:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346891392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574679.803029:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346891392:12345-0@lo:400:kworker.0 Request processed in 26us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574679.803035:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787574679.803055:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346891392:0@lo:400:kworker.0 00000100:00100000:2.0:1787574679.807547:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346891136:0@lo:400:kworker.0 00000100:00100000:2.0:1787574679.807621:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574679.807665:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574679.807673:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346891264:0@lo:400:kworker.0 00000100:00100000:2.0:1787574679.807707:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574679.807743:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346891136 00000100:00100000:2.0:1787574679.807751:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346891136 00000100:00100000:2.0:1787574679.807806:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346891264 00000100:00100000:2.0:1787574679.807809:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346891264 00000100:00100000:2.0:1787574679.807830:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574679.807838:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346891136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574679.807889:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346891136:12345-0@lo:400:kworker.0 Request processed in 51us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574679.807896:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574679.807912:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574679.807918:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346891264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574679.807945:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346891264:12345-0@lo:400:kworker.0 Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574679.807951:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574679.807988:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346891264:0@lo:400:kworker.0 00000100:00100000:2.0:1787574679.807998:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346891136:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.808168:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574679.808177:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346891648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574679.808209:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574679.808269:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346891648 00000100:00100000:3.0:1787574679.808273:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346891648 00000100:00100000:3.0:1787574679.808305:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574679.808312:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346891648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574679.808325:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787574679.808360:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346891648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.808366:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574679.808394:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346891648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574679.808435:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346891776:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.808471:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574679.808496:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346891776 00000100:00100000:3.0:1787574679.808499:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346891776 00000100:00100000:3.0:1787574679.808519:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574679.808525:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346891776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.808555:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346891776:12345-0@lo:400:kworker.0 Request processed in 29us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.808560:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574679.808584:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346891776:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.808614:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346891904:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.808639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574679.808666:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346891904 00000100:00100000:3.0:1787574679.808669:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346891904 00000100:00100000:3.0:1787574679.808692:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787574679.808699:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346891904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.808745:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346891904:12345-0@lo:400:kworker.0 Request processed in 47us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.808751:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787574679.808777:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346891904:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.808802:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574679.808808:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346892032:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.808829:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574679.808853:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346892032 00000100:00100000:3.0:1787574679.808856:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346892032 00000100:00100000:3.0:1787574679.808888:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787574679.808894:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346892032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.808926:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346892032:12345-0@lo:400:kworker.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.808931:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787574679.808956:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346892032:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.808984:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346892160:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.809006:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574679.809029:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346892160 00000100:00100000:3.0:1787574679.809033:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346892160 00000100:00100000:3.0:1787574679.809052:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787574679.809059:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346892160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.809089:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346892160:12345-0@lo:400:kworker.0 Request processed in 31us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.809095:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787574679.809119:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca404389c00 x1874407346892160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574679.809130:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346892160:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.809157:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346892288:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.809180:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574679.809202:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346892288 00000100:00100000:3.0:1787574679.809205:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346892288 00000100:00100000:3.0:1787574679.809226:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787574679.809232:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346892288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.809282:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346892288:12345-0@lo:400:kworker.0 Request processed in 50us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.809295:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787574679.809321:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346892288:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.809350:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346892416:0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.809371:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574679.809391:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346892416 00000100:00100000:3.0:1787574679.809394:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346892416 00000100:00100000:3.0:1787574679.809416:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787574679.809422:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346892416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574679.809465:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346892416:12345-0@lo:400:kworker.0 Request processed in 43us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.809471:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787574679.809495:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca404389c00 x1874407346892416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574679.809505:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346892416:0@lo:400:kworker.0 00000100:00080000:0.0:1787574679.809883:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574679.809888:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574679.809891:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574679.809893:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787574679.922100:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787574679.938229:0:20170:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff272ff7f0 20000000:00000080:0.0:1787574679.938269:0:20170:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ca5317c8c00 uarg=0000000000000000 20000000:01000000:0.0:1787574679.938313:0:20170:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787574679.938320:0:20170:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787574679.938325:0:20170:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787574679.939176:0:20171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787574679.951071:0:20170:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787574679.964285:0:20170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787574679.964378:0:20170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574679.964404:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb91ea expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574679.964413:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb91ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb91f8 expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574679.969567:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fb800/0xd18a1efeeddb923e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9237 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574679.969577:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb939c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9395 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574679.970447:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb94ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba72 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574679.970457:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb952b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bae2 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574679.970527:0:20170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574679.970668:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb952b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bae2 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574679.970690:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb952b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bae2 expref: 12 pid: 17137 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574679.970708:0:20170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504598a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346892544:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574679.970821:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb94ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba72 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574679.970829:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb94ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba72 expref: 12 pid: 17137 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574679.970858:0:20170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346892672:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574679.970894:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb939c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9395 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574679.970902:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb939c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9395 expref: 23 pid: 17135 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574679.970910:0:20170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346892800:0@lo:104: 00000100:00100000:1.0:1787574679.970951:0:20170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574679.970998:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fb800/0xd18a1efeeddb923e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9237 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574679.971005:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5421fb800/0xd18a1efeeddb923e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9237 expref: 23 pid: 17135 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574679.971014:0:20170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca504599180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346892928:0@lo:104: 00000100:00100000:1.0:1787574679.971035:0:20170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574679.971069:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb91ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb91f8 expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574679.971078:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb91ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb91f8 expref: 23 pid: 17136 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574679.971085:0:20170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca50459a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346893056:0@lo:104: 00000100:00100000:1.0:1787574679.971106:0:20170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574679.971125:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb91ea expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574679.971144:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb91ea expref: 23 pid: 17136 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574679.971151:0:20170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346893184:0@lo:104: 00000100:00100000:1.0:1787574679.971172:0:20170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574679.971186:0:20170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574679.971210:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346892800 00000100:00100000:0.0:1787574679.971222:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346892800 00000100:00100000:0.0:1787574679.971315:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346892928 00000100:00100000:0.0:1787574679.971319:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346892928 00000100:00100000:0.0:1787574679.971336:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346893056 00000100:00100000:0.0:1787574679.971339:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346893056 00000100:00100000:0.0:1787574679.971365:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346893184 00000100:00100000:0.0:1787574679.971369:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346893184 00000100:00100000:0.0:1787574679.971387:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574679.971399:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+6:20170:x1874407346892800:12345-0@lo:104: 00010000:00010000:0.0:1787574679.971418:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574679.973043:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787574679.973059:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+6:20170:x1874407346892800:12345-0@lo:104: Request processed in 1658us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574679.973072:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574679.973108:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574679.973119:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+5:20170:x1874407346892928:12345-0@lo:104: 00010000:00010000:2.0:1787574679.973134:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574679.973211:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787574679.973216:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+5:20170:x1874407346892928:12345-0@lo:104: Request processed in 101us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574679.973223:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574679.973236:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574679.973264:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+4:20170:x1874407346893056:12345-0@lo:104: 00010000:00010000:2.0:1787574679.973272:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574679.973301:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787574679.973306:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+4:20170:x1874407346893056:12345-0@lo:104: Request processed in 44us (2199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574679.973311:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574679.973324:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574679.973330:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:20170:x1874407346893184:12345-0@lo:104: 00010000:00010000:2.0:1787574679.973337:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574679.973363:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787574679.973368:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+3:20170:x1874407346893184:12345-0@lo:104: Request processed in 39us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574679.973373:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787574679.973520:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787574679.973528:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973536:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574679.973540:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973548:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574679.973566:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574679.973571:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787574679.973618:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973625:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574679.973644:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973651:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9395 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb939c expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973663:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787574679.973667:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973672:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574679.973675:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973681:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574679.973686:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574679.973691:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787574679.973710:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973715:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574679.973729:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973736:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be74400/0xd18a1efeeddb9237 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb923e expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973744:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574679.973747:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973752:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574679.973755:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973761:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574679.973767:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574679.973771:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787574679.973783:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973788:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574679.973793:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973808:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca40409d000/0xd18a1efeeddb91f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91ff expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973816:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574679.973819:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973824:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574679.973827:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973834:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574679.973840:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574679.973845:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787574679.973860:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973865:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574679.973871:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973876:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca40409c400/0xd18a1efeeddb91ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb91f1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.973888:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574679.973894:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574679.973896:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574679.973912:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346893696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574679.973953:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574679.973991:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574679.973997:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346893312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574679.974017:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574679.974039:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346893440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574679.974060:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574679.974075:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574679.974080:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346893568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574679.974100:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574679.974122:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346893696 00000100:00100000:3.0:1787574679.974129:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346893696 00010000:00010000:3.0:1787574679.974163:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb91ea expref: 24 pid: 17136 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574679.974179:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346893312 00000100:00100000:3.0:1787574679.974182:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346893312 00010000:00010000:3.0:1787574679.974193:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb939c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9395 expref: 25 pid: 17135 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574679.974202:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346893440 00000100:00100000:3.0:1787574679.974205:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346893440 00010000:00010000:3.0:1787574679.974215:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fb800/0xd18a1efeeddb923e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9237 expref: 26 pid: 17135 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574679.974224:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346893568 00000100:00100000:3.0:1787574679.974226:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346893568 00010000:00010000:3.0:1787574679.974236:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb91ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb91f8 expref: 27 pid: 17136 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574679.974304:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574679.974339:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+27:3636:x1874407346893696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574679.974370:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787574679.974384:0:20170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346892800:0@lo:104: 00010000:00010000:0.0:1787574679.974384:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb91ea expref: 27 pid: 17136 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574679.974405:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb91ea expref: 27 pid: 17136 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574679.974428:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574679.974694:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+27:3636:x1874407346893696:12345-0@lo:103:ldlm_bl.0 Request processed in 363us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574679.974747:0:20170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346892928:0@lo:104: 00000100:00100000:1.0:1787574679.974757:0:20170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca50459a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346893056:0@lo:104: 00010000:00010000:1.0:1787574679.974767:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fa400/0xd18a1efeeddb91f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb91ea expref: 27 pid: 17136 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574679.974779:0:20170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346893184:0@lo:104: 00000100:00100000:3.0:1787574679.974829:0:17130:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787574679.974838:0:17130:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787574679.974867:0:17128:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787574679.974876:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574679.974885:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+26:3636:x1874407346893312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574679.974897:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574679.974903:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb939c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9395 expref: 26 pid: 17135 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.974914:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb939c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9395 expref: 26 pid: 17135 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.974930:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb939c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9395 expref: 26 pid: 17135 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.974943:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574679.974977:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+25:3636:x1874407346893312:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.974983:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574679.974999:0:17128:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787574679.975006:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574679.975011:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3634:x1874407346893440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574679.975021:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574679.975025:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fb800/0xd18a1efeeddb923e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9237 expref: 24 pid: 17135 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.975032:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fb800/0xd18a1efeeddb923e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9237 expref: 24 pid: 17135 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.975049:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fb800/0xd18a1efeeddb923e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9237 expref: 24 pid: 17135 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.975057:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574679.975085:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:3634:x1874407346893440:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.975091:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574679.975104:0:17128:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787574679.975110:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574679.975115:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:3634:x1874407346893568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574679.975123:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574679.975128:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb91ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb91f8 expref: 22 pid: 17136 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.975134:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb91ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb91f8 expref: 22 pid: 17136 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.975143:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb91ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb91f8 expref: 22 pid: 17136 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.975150:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574679.975169:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:3634:x1874407346893568:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.975175:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574679.975199:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346893568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574679.975206:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346893440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574679.975740:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787574679.975783:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574679.975819:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346893312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574679.975833:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346893696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574679.976891:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574679.977051:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323728128 00000100:00100000:3.0:1787574679.977068:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323728128 00010000:00010000:3.0:1787574679.977111:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb94ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba72 expref: 13 pid: 17137 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574679.977151:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1787574679.977160:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53c0d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2404:x1874407323728128:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574679.977173:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574679.977179:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb94ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba72 expref: 13 pid: 17137 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.977190:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb94ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba72 expref: 13 pid: 17137 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.977209:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574679.977296:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53c0d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2404:x1874407323728128:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 136us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.977304:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:2.0:1787574679.977820:0:20170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504598a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346892544:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574679.977832:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb94ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba72 expref: 12 pid: 17137 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574679.977856:0:20170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca504599f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1874407346892672:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574679.977889:0:20170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574679.983651:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574679.983736:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323728000 00000100:00100000:3.0:1787574679.983747:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323728000 00010000:00010000:3.0:1787574679.983793:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb952b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bae2 expref: 12 pid: 17137 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574679.983965:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:3.0:1787574679.983976:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ab24719-8af9-48f9-8992-e0214b678d6f+12:2404:x1874407323728000:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574679.983991:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574679.983998:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb952b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bae2 expref: 12 pid: 17137 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984012:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb952b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bae2 expref: 12 pid: 17137 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984044:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74000/0xd18a1efeeddb952b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bae2 expref: 12 pid: 17137 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984060:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984068:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984095:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984103:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984109:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984116:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984122:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574679.984126:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984133:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984152:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574679.984173:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574679.984229:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9ab24719-8af9-48f9-8992-e0214b678d6f+11:2404:x1874407323728000:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 255us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574679.984236:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00010000:00010000:2.0:1787574679.985177:0:20170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574679.985188:0:20170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574679.985194:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500031600/0xd18a1efeeddb955c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574680.946483:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574681.034990:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574681.035508:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323728256 00000100:00100000:2.0:1787574681.035519:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323728256 00000100:00100000:2.0:1787574681.035584:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 149 00000100:00100000:2.0:1787574681.035595:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+11:14943:x1874407323728256:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574681.035614:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574681.035635:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb9563 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb1a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574681.035662:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb9563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb1a expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574681.035674:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb9563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb1a expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574681.035696:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83400, rc 0) 00000100:00100000:2.0:1787574681.035751:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+12:14943:x1874407323728256:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 159us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574681.035758:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 149 00000100:00100000:0.0:1787574681.049496:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574681.049582:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323728384 00000100:00100000:2.0:1787574681.049592:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323728384 00000100:00100000:2.0:1787574681.049657:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 150 00000100:00100000:2.0:1787574681.049670:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+12:14943:x1874407323728384:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574681.049830:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+12:14943:x1874407323728384:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 162us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574681.049838:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 150 00000100:00100000:2.0:1787574681.054636:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574681.054720:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323728512 00000100:00100000:3.0:1787574681.054730:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323728512 00000100:00100000:3.0:1787574681.054785:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:3.0:1787574681.054795:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+12:14943:x1874407323728512:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574681.054926:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+12:14943:x1874407323728512:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 131us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574681.054935:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:3.0:1787574681.081070:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574681.081153:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323728640 00000100:00100000:0.0:1787574681.081164:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323728640 00000100:00100000:0.0:1787574681.081225:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:0.0:1787574681.081236:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+12:14943:x1874407323728640:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574681.081277:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574681.081295:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca500031c00/0xd18a1efeeddb956a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb21 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.081322:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500031c00/0xd18a1efeeddb956a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb21 expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.081333:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca500031c00/0xd18a1efeeddb956a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb21 expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.081365:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031c00, rc 0) 00000100:00100000:0.0:1787574681.082063:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+13:14943:x1874407323728640:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 826us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574681.082072:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:0.0:1787574681.097599:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574681.097782:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323728768 00000100:00100000:3.0:1787574681.097793:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323728768 00000100:00100000:3.0:1787574681.097856:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 153 00000100:00100000:3.0:1787574681.097869:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f47dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+13:14943:x1874407323728768:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574681.098039:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f47dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+13:14943:x1874407323728768:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 173us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574681.098048:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 153 00000100:00100000:0.0:1787574681.104628:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574681.105520:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323728896 00000100:00100000:1.0:1787574681.105531:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323728896 00000100:00100000:1.0:1787574681.105592:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00100000:1.0:1787574681.105601:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+13:14943:x1874407323728896:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574681.105746:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+13:14943:x1874407323728896:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 145us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574681.105754:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 154 10000000:01000000:1.0:1787574681.141928:0:17139:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787574681.141937:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca510a59000 from 13 10000000:01000000:1.0:1787574681.141941:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574681.141989:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574681.142008:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574681.142021:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574681.142063:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346893824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574681.143029:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574681.143526:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574681.143825:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346893824 00000100:00100000:2.0:1787574681.143836:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346893824 00000100:00100000:2.0:1787574681.143904:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787574681.143915:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:17139:x1874407346893824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574681.143931:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574681.143951:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82600/0xd18a1efeeddb9578 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9571 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574681.143979:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82600/0xd18a1efeeddb9578 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9571 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574681.143990:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82600/0xd18a1efeeddb9578 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9571 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574681.144017:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82600, rc 0) 00000100:00100000:2.0:1787574681.144078:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:17139:x1874407346893824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574681.144086:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787574681.146975:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346893824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574681.147004:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574681.147016:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574681.147284:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346893952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574681.147476:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574681.147527:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574681.147543:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346893952 00000100:00100000:0.0:1787574681.147552:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346893952 00000100:00100000:0.0:1787574681.147606:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787574681.147617:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:17139:x1874407346893952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574681.147754:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:17139:x1874407346893952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574681.147762:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787574681.148539:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346893952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574681.148587:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574681.148639:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574681.148680:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574681.148974:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346894080 00000100:00100000:0.0:1787574681.148980:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346894080 00000100:00100000:0.0:1787574681.149029:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787574681.149038:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:17139:x1874407346894080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574681.149155:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:17139:x1874407346894080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574681.149161:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787574681.149277:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787574681.150364:0:20222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787574681.152403:0:17139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787574681.152450:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574681.152462:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.152487:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574681.152498:0:17139:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574681.152500:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53be15800 from 13 10000000:01000000:0.0:1787574681.152503:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574681.152540:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.152549:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.152560:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574681.152586:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e763b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574681.152654:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574681.152699:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574681.153010:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346894208 00000100:00100000:3.0:1787574681.153018:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346894208 00000100:00100000:3.0:1787574681.153072:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787574681.153082:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:17139:x1874407346894208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574681.153094:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574681.153108:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb9586 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb957f expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574681.153130:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb9586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb957f expref: 22 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574681.153141:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb9586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb957f expref: 22 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574681.153150:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19800, rc 0) 00000100:00100000:3.0:1787574681.153197:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:17139:x1874407346894208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574681.153204:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787574681.153260:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e763b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574681.153278:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574681.153297:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574681.153455:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574681.153487:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574681.153522:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574681.153616:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346894336 00000100:00100000:0.0:1787574681.153622:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346894336 00000100:00100000:0.0:1787574681.153655:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787574681.153663:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:17139:x1874407346894336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574681.153768:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:17139:x1874407346894336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574681.153775:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787574681.154510:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574681.154551:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574681.154597:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574681.154619:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574681.156358:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346894464 00000100:00100000:0.0:1787574681.156371:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346894464 00000100:00100000:0.0:1787574681.156449:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787574681.156470:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:17139:x1874407346894464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574681.156615:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:17139:x1874407346894464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574681.156624:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787574681.156641:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787574681.157462:0:20223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787574681.159088:0:17139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787574681.159119:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574681.159132:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.159144:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574681.159155:0:17139:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574681.159158:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca4033ba000 from 13 10000000:01000000:0.0:1787574681.159161:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574681.159198:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.159206:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.159216:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574681.159277:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e763100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574681.159343:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574681.159400:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507efee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574681.159553:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346894592 00000100:00100000:3.0:1787574681.159560:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346894592 00000100:00100000:3.0:1787574681.159607:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787574681.159616:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:17139:x1874407346894592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574681.159628:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574681.159641:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca509e18a00/0xd18a1efeeddb9594 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb958d expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574681.159664:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca509e18a00/0xd18a1efeeddb9594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb958d expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574681.159676:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca509e18a00/0xd18a1efeeddb9594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb958d expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574681.159703:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e18a00, rc 0) 00000100:00100000:3.0:1787574681.159751:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:17139:x1874407346894592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574681.159758:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787574681.160042:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e763100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574681.160058:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574681.160079:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574681.160136:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574681.160162:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574681.160192:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574681.160318:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346894720 00000100:00100000:0.0:1787574681.160323:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346894720 00000100:00100000:0.0:1787574681.160359:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787574681.160366:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:17139:x1874407346894720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574681.160597:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:17139:x1874407346894720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574681.160605:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787574681.160705:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574681.160733:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574681.160772:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574681.160800:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5353b2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574681.160847:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346894848 00000100:00100000:0.0:1787574681.160852:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346894848 00000100:00100000:0.0:1787574681.160882:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787574681.160889:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:17139:x1874407346894848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574681.160959:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:17139:x1874407346894848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574681.160966:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787574681.161003:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787574681.161843:0:20224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787574681.161921:0:17139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787574681.161942:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574681.161958:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574681.161968:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574681.161978:0:17139:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787574681.161981:0:17139:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53f52b800 from 13 10000000:01000000:1.0:1787574681.161983:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574681.162007:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574681.162015:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574681.162023:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574681.162038:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574681.162142:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574681.162176:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787574681.162325:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346894976 00000100:00100000:0.0:1787574681.162330:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346894976 00000100:00100000:0.0:1787574681.162369:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787574681.162454:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:17139:x1874407346894976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574681.162465:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574681.162478:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca500030c00/0xd18a1efeeddb95a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb959b expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.162693:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca500030c00/0xd18a1efeeddb95a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb959b expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.162706:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca500030c00/0xd18a1efeeddb95a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb959b expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574681.162727:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500030c00, rc 0) 00000100:00100000:0.0:1787574681.162775:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:17139:x1874407346894976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 325us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574681.162782:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787574681.162818:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346894976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574681.162845:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574681.162854:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574681.162904:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346895104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574681.162939:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574681.162975:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574681.163013:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346895104 00000100:00100000:3.0:1787574681.163019:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346895104 00000100:00100000:3.0:1787574681.163053:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787574681.163059:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:17139:x1874407346895104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574681.163160:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:17139:x1874407346895104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574681.163167:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787574681.163231:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346895104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574681.163369:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e762d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346895232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574681.163421:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574681.163497:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5219196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574681.163668:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346895232 00000100:00100000:3.0:1787574681.163673:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346895232 00000100:00100000:3.0:1787574681.163700:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787574681.163707:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:17139:x1874407346895232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574681.165534:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:17139:x1874407346895232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1822us (2107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574681.165546:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787574681.166846:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e762d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:17139:1874407346895232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787574681.167738:0:20225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787574681.167913:0:17139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787574681.167935:0:17139:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574681.167947:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574681.167959:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574681.974708:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574682.353494:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574682.353521:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346895360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574682.353595:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574682.353712:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346895360 00000100:00100000:3.0:1787574682.353721:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346895360 00000100:00100000:3.0:1787574682.353817:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787574682.353817:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574682.353831:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346895360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574682.353859:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574682.353910:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346895360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574682.353917:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574682.354167:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346895360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574682.895170:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574682.895224:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574682.895307:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574682.895332:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574682.895364:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574682.895375:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323729152 00000100:00100000:3.0:1787574682.895380:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574682.895385:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323729152 00000100:00100000:3.0:1787574682.895396:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574682.895424:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574682.895445:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323729664 00000100:00100000:2.0:1787574682.895449:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323729664 00000100:00100000:3.0:1787574682.895461:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574682.895461:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323729280 00000100:00100000:2.0:1787574682.895463:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323729280 00000100:00100000:2.0:1787574682.895474:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323729792 00000100:00100000:2.0:1787574682.895477:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323729792 00000100:00100000:3.0:1787574682.895482:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323729408 00000100:00100000:3.0:1787574682.895484:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323729408 00000100:00100000:2.0:1787574682.895492:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:2.0:1787574682.895500:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:2402:x1874407323729152:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574682.895502:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323729920 00000100:00100000:3.0:1787574682.895504:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323729920 00000100:00100000:3.0:1787574682.895514:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323729536 00000100:00100000:3.0:1787574682.895516:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323729536 00000100:00100000:3.0:1787574682.895525:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323730048 00000100:00100000:3.0:1787574682.895527:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323730048 00000100:00100000:3.0:1787574682.895539:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1787574682.895545:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2402:x1874407323729408:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574682.895635:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:0.0:1787574682.895647:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f06173-8373-497a-8777-dc305c5dce24+6:2402:x1874407323729664:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574682.895724:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:1.0:1787574682.895734:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26f06173-8373-497a-8777-dc305c5dce24+5:2402:x1874407323729920:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574682.895778:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:2402:x1874407323729152:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 73us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574682.895787:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:2.0:1787574682.895805:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:2.0:1787574682.895812:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323729280:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574682.896005:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2402:x1874407323729408:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 458us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574682.896012:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1787574682.896038:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1787574682.896045:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323729536:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574682.896545:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323729536:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 499us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574682.896552:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1787574682.896565:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1787574682.896572:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323730048:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574682.896597:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323730048:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574682.896603:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1787574682.896626:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323729024 00000100:00100000:3.0:1787574682.896631:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323729024 00000100:00100000:3.0:1787574682.896667:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:3.0:1787574682.896673:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2403:x1874407323729024:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574682.896698:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2403:x1874407323729024:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574682.896703:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:3.0:1787574682.897199:0:17145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787574682.897209:0:17145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787574682.897257:0:17144:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787574682.897267:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1787574682.897275:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323729792:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574682.897302:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323729792:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574682.897309:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00080000:3.0:1787574682.898594:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574682.898603:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574682.898606:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574682.898608:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574682.901276:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f06173-8373-497a-8777-dc305c5dce24+6:2402:x1874407323729664:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 5610us (5946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574682.901293:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:1.0:1787574682.902235:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26f06173-8373-497a-8777-dc305c5dce24+5:2402:x1874407323729920:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 6495us (6894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574682.903797:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1787574682.908221:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323729280:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 12396us (12825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574682.908252:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00010000:00010000:3.0:1787574682.993571:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574683.377572:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574683.377597:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346895488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574683.377672:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574683.377817:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346895488 00000100:00100000:3.0:1787574683.377826:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346895488 00000100:00100000:3.0:1787574683.377889:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787574683.377900:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346895488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574683.377923:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574683.377977:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346895488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574683.377984:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787574683.378041:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574683.378263:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346895488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574683.386469:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.391544:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323730176 00000100:00100000:0.0:1787574683.391561:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323730176 00000100:00100000:0.0:1787574683.391653:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:0.0:1787574683.391663:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:15606:x1874407323730176:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574683.391682:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574683.391704:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb95a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb28 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.391771:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb95b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.391786:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb95b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.391798:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb95b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.391812:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb95b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.391820:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb95b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.391827:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb95b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.391901:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb95be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.391910:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb95be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.391917:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb95be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574683.391956:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574683.391960:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574683.391996:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb95be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392007:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb95b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392014:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb95b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392021:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb95b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392026:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574683.392031:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb95b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392038:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb95b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392050:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca52057de00) 00010000:00010000:0.0:1787574683.392053:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574683.392058:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb95b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392064:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb95b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392080:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb95b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392097:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb95b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392104:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb95b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392109:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574683.392113:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb95b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392120:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb95b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392129:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ca534a4b800) 00010000:00010000:0.0:1787574683.392131:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574683.392134:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb95b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392140:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb95b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392172:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb95a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb28 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392185:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb95be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb28 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.392193:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ca534a4b700) 00010000:00010000:0.0:1787574683.392196:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574683.392203:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409dc00, rc 0) 00000100:00100000:0.0:1787574683.392325:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:15606:x1874407323730176:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 662us (5865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574683.392332:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1787574683.396494:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.396775:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323730304 00000100:00100000:0.0:1787574683.396785:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323730304 00000100:00100000:0.0:1787574683.396845:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1787574683.396854:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:15606:x1874407323730304:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787574683.396935:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:15606:x1874407323730304:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 Request processed in 82us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574683.396942:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:2.0:1787574683.404902:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574683.405956:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323730560 00000100:00100000:3.0:1787574683.405969:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323730560 00000100:00100000:3.0:1787574683.406039:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1787574683.406051:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:15606:x1874407323730560:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574683.406072:0:20285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574683.406095:0:20285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb95c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb2f expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.406174:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb95cc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.406189:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb95cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.406200:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb95cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.406304:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb95d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.406313:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb95d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.406335:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb95d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.409141:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb95da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.409165:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb95da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.409177:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb95da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574683.409191:0:20285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787574683.409707:0:20285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb95cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.409717:0:20285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb95cc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.409725:0:20285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb95cc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.409730:0:20285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574683.409735:0:20285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb95cc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.409753:0:20285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb95cc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.410297:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ca534a4b700) 00010000:00010000:3.0:1787574683.410302:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574683.410308:0:20285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb95cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.410326:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb95cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.410343:0:20285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb95d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.410350:0:20285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb95d3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.410356:0:20285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb95d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.410369:0:20285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574683.410372:0:20285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb95d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.410377:0:20285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb95d3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.410384:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ca502b84e00) 00010000:00010000:3.0:1787574683.410387:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574683.410390:0:20285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb95d3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.410418:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb95d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.414017:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb95c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb2f expref: 10 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.414045:0:20285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb95da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb2f expref: 9 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.414055:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca502b84b00) 00010000:00010000:3.0:1787574683.414058:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574683.414062:0:20285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502fabe00, rc 0) 00000100:00100000:3.0:1787574683.414143:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+9:15606:x1874407323730560:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 8092us (9248us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787574683.414151:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1787574683.426582:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574683.426846:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323730688 00000100:00100000:2.0:1787574683.426870:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323730688 00000100:00100000:2.0:1787574683.426935:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:2.0:1787574683.426946:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+9:15606:x1874407323730688:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787574683.427056:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+9:15606:x1874407323730688:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 110us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574683.427064:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:0.0:1787574683.430866:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574683.430952:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323730816 00000100:00100000:3.0:1787574683.430963:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323730816 00000100:00100000:3.0:1787574683.431019:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1787574683.431040:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:15606:x1874407323730816:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1787574683.434449:0:17145:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3357us 00000100:00100000:0.0:1787574683.458045:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:15606:x1874407323730816:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 27009us (27181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574683.458059:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1787574683.500731:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.500855:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323730944 00000100:00100000:0.0:1787574683.500866:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323730944 00000100:00100000:0.0:1787574683.500932:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:0.0:1787574683.500944:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+9:15612:x1874407323730944:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574683.500965:0:20285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574683.500987:0:20285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb36 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501051:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb95ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501065:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb95ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501092:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb95ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501110:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb95f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501118:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb95f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501125:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb95f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501167:0:20285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb95ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501176:0:20285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb95ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501183:0:20285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb95ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501189:0:20285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574683.501194:0:20285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb95ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501202:0:20285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb95ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501215:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca52057de00) 00010000:00010000:0.0:1787574683.501218:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574683.501224:0:20285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb95ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501338:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb95ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501512:0:20285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb95f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501520:0:20285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb95f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501527:0:20285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb95f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501532:0:20285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409ca00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574683.501536:0:20285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb95f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501542:0:20285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb95f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501551:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ca534a4b800) 00010000:00010000:0.0:1787574683.501553:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574683.501556:0:20285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb95f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501562:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb95f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501597:0:20285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb36 expref: 10 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501620:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca52057de00) 00010000:00010000:0.0:1787574683.501622:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574683.501626:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb36 expref: 10 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.501635:0:20285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d000, rc 0) 00000100:00100000:0.0:1787574683.503535:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+9:15612:x1874407323730944:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2579us (2801us total) trans 0 rc 301/301 00000100:00100000:0.0:1787574683.503550:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:1.0:1787574683.511902:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.512004:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323731072 00000100:00100000:0.0:1787574683.512014:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323731072 00000100:00100000:0.0:1787574683.512087:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1787574683.512099:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1d414e73-1942-4e41-ad1c-8720ad754d4d+9:15612:x1874407323731072:12345-192.168.202.40@tcp:700:lfs.0 00000100:00100000:0.0:1787574683.512186:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1d414e73-1942-4e41-ad1c-8720ad754d4d+9:15612:x1874407323731072:12345-192.168.202.40@tcp:700:lfs.0 Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574683.512194:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:3.0:1787574683.515026:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.515194:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323731328 00000100:00100000:0.0:1787574683.515205:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323731328 00000100:00100000:0.0:1787574683.515297:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1787574683.515309:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+9:15612:x1874407323731328:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:0.0:1787574683.515548:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574683.515577:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd83e00/0xd18a1efeeddb9516 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9baa3 expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.515598:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca52057de00) 00010000:00010000:0.0:1787574683.515618:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574683.515677:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.515691:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb13 expref: 5 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.515699:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.515735:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb13 expref: 5 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.515749:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb13 expref: 5 pid: 17145 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574683.515763:0:17144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e762300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346895616:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574683.515946:0:17144:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51e9a1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574683.521489:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574683.521585:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323731456 00000100:00100000:1.0:1787574683.521595:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323731456 00010000:00010000:1.0:1787574683.521643:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb13 expref: 6 pid: 17145 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574683.521688:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:1.0:1787574683.521700:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26f06173-8373-497a-8777-dc305c5dce24+6:2404:x1874407323731456:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574683.521731:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574683.521738:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb13 expref: 6 pid: 17145 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.521753:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb13 expref: 6 pid: 17145 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.521776:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca52057de00) 00010000:00010000:1.0:1787574683.521781:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.521791:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.521799:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.521817:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574683.521877:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26f06173-8373-497a-8777-dc305c5dce24+6:2404:x1874407323731456:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 179us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574683.521885:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00010000:00010000:0.0:1787574683.523592:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9555 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb13 expref: 5 pid: 17145 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574683.523617:0:17144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e762300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346895616:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574683.523640:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.523651:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.523658:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.523700:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.523713:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.523723:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.527963:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.527985:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.527997:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574683.528016:0:17144:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e99ae62 reply state 00000000e935586a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.528027:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.528033:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:0.0:1787574683.528036:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574683.528039:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787574683.528043:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787574683.528123:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.528131:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.528147:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.528152:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574683.528157:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.528165:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.528175:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca52057de00) 00010000:00010000:0.0:1787574683.528178:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574683.528182:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.528188:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb95fd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574683.528209:0:17144:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e99ae62 reply state 00000000e935586a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.528217:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.528222:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ca534a4b800) 00010000:00010000:0.0:1787574683.528224:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574683.528226:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787574683.528582:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+10:15612:x1874407323731328:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 13270us (13564us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787574683.528592:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:2.0:1787574683.614578:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.614914:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323731584 00000100:00100000:0.0:1787574683.614924:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323731584 00000100:00100000:0.0:1787574683.614988:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1787574683.615000:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+10:15620:x1874407323731584:12345-192.168.202.40@tcp:101:lctl.0 00010000:00010000:0.0:1787574683.615024:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574683.615062:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb3d expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.615126:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9619 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.615139:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.615150:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574683.615190:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574683.615194:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574683.615230:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.615445:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb3d expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.615465:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9619 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb3d expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.615474:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4be00) 00010000:00010000:0.0:1787574683.615477:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574683.615495:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d200, rc 0) 00000100:00100000:3.0:1787574683.615748:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+11:15620:x1874407323731584:12345-192.168.202.40@tcp:101:lctl.0 Request processed in 749us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574683.615764:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:1.0:1787574683.654695:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.654835:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323731712 00000100:00100000:0.0:1787574683.654846:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323731712 00000100:00100000:0.0:1787574683.654913:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:0.0:1787574683.654925:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26f06173-8373-497a-8777-dc305c5dce24+5:15621:x1874407323731712:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574683.654945:0:20285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574683.654968:0:20285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb44 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.655058:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddb9627 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.655073:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddb9627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.655086:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddb9627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574683.655139:0:20285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574683.655144:0:20285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574683.655166:0:20285:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddb9627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.655194:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb44 expref: 7 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.655213:0:20285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddb9627 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb44 expref: 6 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.655222:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4be00) 00010000:00010000:0.0:1787574683.655301:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574683.655306:0:20285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c400, rc 0) 00000100:00100000:0.0:1787574683.655376:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26f06173-8373-497a-8777-dc305c5dce24+6:15621:x1874407323731712:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 453us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574683.655384:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:0.0:1787574683.660781:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574683.664504:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323731840 00000100:00100000:3.0:1787574683.664523:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323731840 00000100:00100000:3.0:1787574683.664603:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1787574683.664615:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+6:15621:x1874407323731840:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574683.664636:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574683.664657:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb962e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb4b expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.664722:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb9635 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.664737:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb9635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.667983:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb9635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.668029:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb963c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.668044:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb963c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.668057:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb963c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.668946:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb9643 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.668962:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb9643 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.668992:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb9643 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574683.669042:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787574683.669046:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574683.669070:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb9643 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669083:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb9635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669089:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb9635 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669097:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb9635 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669103:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574683.669108:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb9635 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669115:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb9635 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669545:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4be00) 00010000:00010000:3.0:1787574683.669550:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574683.669555:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb9635 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669562:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb9635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669589:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb963c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669596:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb963c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669601:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb963c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669606:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabc00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574683.669609:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb963c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669615:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb963c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669625:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ca534a4b800) 00010000:00010000:3.0:1787574683.669627:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574683.669630:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb963c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669635:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb963c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669673:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb962e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb4b expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669687:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb9643 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb4b expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.669705:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:3.0:1787574683.669707:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574683.669710:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faa400, rc 0) 00000100:00100000:3.0:1787574683.670365:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+7:15621:x1874407323731840:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 5748us (9604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574683.670376:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:1.0:1787574683.682459:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.682575:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323731968 00000100:00100000:0.0:1787574683.682587:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323731968 00000100:00100000:0.0:1787574683.682701:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:0.0:1787574683.682712:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:26f06173-8373-497a-8777-dc305c5dce24+5:15621:x1874407323731968:12345-192.168.202.40@tcp:900:lfs.0 00000100:00100000:0.0:1787574683.682807:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:26f06173-8373-497a-8777-dc305c5dce24+5:15621:x1874407323731968:12345-192.168.202.40@tcp:900:lfs.0 Request processed in 97us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574683.682814:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1787574683.699149:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574683.699278:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323732224 00000100:00100000:3.0:1787574683.699290:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323732224 00000100:00100000:3.0:1787574683.699352:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:3.0:1787574683.699364:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f06173-8373-497a-8777-dc305c5dce24+7:15621:x1874407323732224:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574683.699385:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574683.699415:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb964a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb52 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574683.699527:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787574683.699628:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb964a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb52 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.699643:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4be00) 00010000:00010000:3.0:1787574683.699646:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574683.699651:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb964a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb52 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.699665:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faa800, rc 0) 00000100:00100000:3.0:1787574683.699729:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f06173-8373-497a-8777-dc305c5dce24+8:15621:x1874407323732224:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 368us (591us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787574683.699762:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:3.0:1787574683.714803:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.714988:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323732480 00000100:00100000:0.0:1787574683.715002:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323732480 00000100:00100000:0.0:1787574683.715086:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:0.0:1787574683.715099:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f06173-8373-497a-8777-dc305c5dce24+8:15621:x1874407323732480:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:0.0:1787574683.715181:0:19986:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574683.715322:0:19986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb9643 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb4b expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.715351:0:19986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:0.0:1787574683.715357:0:19986:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574683.715389:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.715415:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.715443:0:19986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574683.715916:0:19986:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f370cc8 reply state 00000000c3cc31cd transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.715932:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.715939:0:19986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:0.0:1787574683.715942:0:19986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1787574683.715946:0:19986:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787574683.715954:0:19986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787574683.716458:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f06173-8373-497a-8777-dc305c5dce24+9:15621:x1874407323732480:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 1357us (1669us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787574683.716468:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:1.0:1787574683.732622:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574683.737778:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323732736 00000100:00100000:2.0:1787574683.737802:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323732736 00000100:00100000:2.0:1787574683.738017:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:2.0:1787574683.738039:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26f06173-8373-497a-8777-dc305c5dce24+9:15621:x1874407323732736:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1787574683.738578:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26f06173-8373-497a-8777-dc305c5dce24+10:15621:x1874407323732736:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 539us (6030us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787574683.738589:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:1.0:1787574683.743316:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574683.743553:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323732992 00000100:00100000:3.0:1787574683.743567:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323732992 00000100:00100000:3.0:1787574683.743657:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:3.0:1787574683.743671:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+10:15621:x1874407323732992:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574683.743707:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574683.743735:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb965f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb59 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.743844:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9666 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.743863:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.743875:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.743887:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb966d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.743894:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb966d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.743899:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb966d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574683.744039:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787574683.744170:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744180:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9666 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744187:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9666 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744195:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabc00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574683.744201:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9666 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744210:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9666 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744291:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4be00) 00010000:00010000:3.0:1787574683.744295:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574683.744301:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744308:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744328:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb966d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744334:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb966d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744341:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb966d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744356:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574683.744370:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb966d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744376:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb966d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744385:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ca534a4b800) 00010000:00010000:3.0:1787574683.744388:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574683.744391:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb966d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744397:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb966d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744450:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb965f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb59 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744461:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4be00) 00010000:00010000:3.0:1787574683.744464:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574683.744467:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb965f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb59 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.744478:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faa800, rc 0) 00000100:00100000:3.0:1787574683.744570:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+11:15621:x1874407323732992:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 902us (1272us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787574683.744580:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:3.0:1787574683.755700:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.755855:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323733120 00000100:00100000:0.0:1787574683.755865:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323733120 00000100:00100000:0.0:1787574683.755921:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:0.0:1787574683.755931:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26f06173-8373-497a-8777-dc305c5dce24+11:15621:x1874407323733120:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574683.755955:0:20285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574683.755976:0:20285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb967b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb60 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.756079:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.756093:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.756114:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574683.756139:0:20285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574683.756142:0:20285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574683.756160:0:20285:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.756188:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb967b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb60 expref: 13 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.756210:0:20285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb60 expref: 12 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.756219:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:0.0:1787574683.756222:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574683.756226:0:20285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca500031600, rc 0) 00000100:00100000:0.0:1787574683.756356:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26f06173-8373-497a-8777-dc305c5dce24+12:15621:x1874407323733120:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 426us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574683.756364:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:1.0:1787574683.769413:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.769605:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323733248 00000100:00100000:0.0:1787574683.769618:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323733248 00000100:00100000:0.0:1787574683.769739:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:0.0:1787574683.769751:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26f06173-8373-497a-8777-dc305c5dce24+12:15621:x1874407323733248:12345-192.168.202.40@tcp:37:lfs.0 00000100:00100000:0.0:1787574683.785088:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26f06173-8373-497a-8777-dc305c5dce24+12:15621:x1874407323733248:12345-192.168.202.40@tcp:37:lfs.0 Request processed in 15329us (15685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574683.785102:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1787574683.800712:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574683.800887:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323733504 00000100:00100000:2.0:1787574683.800899:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323733504 00000100:00100000:2.0:1787574683.800962:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:2.0:1787574683.800973:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535e43850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26f06173-8373-497a-8777-dc305c5dce24+12:15621:x1874407323733504:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1787574683.801707:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535e43850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26f06173-8373-497a-8777-dc305c5dce24+13:15621:x1874407323733504:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 732us (1002us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787574683.801734:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1787574683.938727:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.939970:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323733632 00000100:00100000:0.0:1787574683.939984:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323733632 00000100:00100000:0.0:1787574683.940064:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:0.0:1787574683.940075:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+11:15627:x1874407323733632:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1787574683.940098:0:19986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574683.940120:0:19986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9689 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb67 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940189:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb9690 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940204:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb9690 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940217:0:19986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb9690 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940229:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb9697 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940236:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb9697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940291:0:19986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb9697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940496:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8000/0xd18a1efeeddb969e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940506:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8000/0xd18a1efeeddb969e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940524:0:19986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8000/0xd18a1efeeddb969e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574683.940562:0:19986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574683.940566:0:19986:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574683.940606:0:19986:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8000/0xd18a1efeeddb969e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940620:0:19986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb9690 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940626:0:19986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb9690 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940633:0:19986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb9690 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940640:0:19986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574683.940644:0:19986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb9690 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940652:0:19986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb9690 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940666:0:19986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4be00) 00010000:00010000:0.0:1787574683.940670:0:19986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574683.940674:0:19986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb9690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940681:0:19986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031a00/0xd18a1efeeddb9690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940707:0:19986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb9697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940713:0:19986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb9697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940718:0:19986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb9697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940723:0:19986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574683.940726:0:19986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb9697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940732:0:19986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb9697 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.940740:0:19986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ca534a4b800) 00010000:00010000:0.0:1787574683.940742:0:19986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574683.942618:0:19986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb9697 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.942651:0:19986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030a00/0xd18a1efeeddb9697 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.942715:0:19986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500030800/0xd18a1efeeddb9689 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb67 expref: 13 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.942732:0:19986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8000/0xd18a1efeeddb969e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb67 expref: 12 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.942777:0:19986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:0.0:1787574683.942780:0:19986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787574683.942783:0:19986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a8000, rc 0) 00000100:00100000:0.0:1787574683.942871:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+12:15627:x1874407323733632:12345-192.168.202.40@tcp:101:bash.0 Request processed in 2796us (4154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574683.942879:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:1.0:1787574683.953883:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574683.954010:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323733760 00000100:00100000:2.0:1787574683.954020:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323733760 00000100:00100000:2.0:1787574683.954122:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1787574683.954146:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:15627:x1874407323733760:12345-192.168.202.40@tcp:900:bash.0 00000100:00100000:2.0:1787574683.954263:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:15627:x1874407323733760:12345-192.168.202.40@tcp:900:bash.0 Request processed in 109us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574683.954291:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:1.0:1787574683.958361:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.958734:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323734016 00000100:00100000:0.0:1787574683.958744:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323734016 00000100:00100000:0.0:1787574683.958823:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:0.0:1787574683.958835:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+12:15627:x1874407323734016:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1787574683.958856:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574683.958876:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8200/0xd18a1efeeddb96a5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb6e expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.958985:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.959001:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb60 expref: 12 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.959011:0:17145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.959044:0:17145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb60 expref: 12 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574683.959059:0:17145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb60 expref: 12 pid: 20285 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574683.959087:0:17145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e760000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1874407346895744:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574683.959183:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51e9a1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574683.967660:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574683.967707:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e760000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1874407346895744:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574683.967737:0:17145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574683.967918:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323734144 00000100:00100000:3.0:1787574683.967926:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323734144 00010000:00010000:3.0:1787574683.967974:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb60 expref: 13 pid: 20285 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574683.968018:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1787574683.968029:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26f06173-8373-497a-8777-dc305c5dce24+13:2404:x1874407323734144:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574683.968056:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574683.968063:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb60 expref: 13 pid: 20285 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.968076:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb60 expref: 13 pid: 20285 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.968102:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca500031600/0xd18a1efeeddb9682 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb60 expref: 13 pid: 20285 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.968121:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:3.0:1787574683.968125:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.968135:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.968144:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574683.968180:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787574683.968461:0:17145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.968470:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.968498:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.968510:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.968518:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969069:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb96ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969081:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb96ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969088:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb96ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574683.969100:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787574683.969127:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969143:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969149:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969155:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a8800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574683.969159:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969167:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969179:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:1.0:1787574683.969182:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574683.969186:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969192:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8800/0xd18a1efeeddb96ac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574683.969204:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b308e3b reply state 0000000012ce427f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969214:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969220:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ca51874ab00) 00010000:00010000:1.0:1787574683.969223:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787574683.969226:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787574683.969300:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8200/0xd18a1efeeddb96a5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb6e expref: 15 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969338:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb96ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb6e expref: 14 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574683.969346:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:1.0:1787574683.969348:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787574683.969350:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75400, rc 0) 00000100:00100000:3.0:1787574683.969535:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26f06173-8373-497a-8777-dc305c5dce24+12:2404:x1874407323734144:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 1505us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574683.969547:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1787574683.969751:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+15:15627:x1874407323734016:12345-192.168.202.40@tcp:101:bash.0 Request processed in 10918us (11400us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787574683.969759:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:1.0:1787574683.996629:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574683.996710:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323734272 00000100:00100000:2.0:1787574683.996722:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323734272 00000100:00100000:2.0:1787574683.996789:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:2.0:1787574683.996801:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+15:15627:x1874407323734272:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574683.996827:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574683.996850:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82c00/0xd18a1efeeddb96c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb75 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574683.996915:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574683.996930:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574683.996941:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574683.996989:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787574683.996993:0:17142:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574683.997014:0:17142:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574683.997022:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574683.997042:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82c00/0xd18a1efeeddb96c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb75 expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574683.997055:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb75 expref: 16 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574683.997072:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:2.0:1787574683.997074:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574683.997077:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82200, rc 0) 00000100:00100000:2.0:1787574683.997126:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+16:15627:x1874407323734272:12345-192.168.202.40@tcp:101:bash.0 Request processed in 328us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574683.997134:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:2.0:1787574684.001808:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574684.001994:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323734528 00000100:00100000:1.0:1787574684.002005:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323734528 00000100:00080000:0.0:1787574684.002297:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574684.005802:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:1.0:1787574684.005827:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+16:15627:x1874407323734528:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:1.0:1787574684.006142:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+17:15627:x1874407323734528:12345-192.168.202.40@tcp:35:bash.0 Request processed in 327us (4344us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787574684.006150:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00010000:00010000:0.0:1787574684.018202:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574684.124365:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574684.124544:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323734784 00000100:00100000:0.0:1787574684.124555:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323734784 00000100:00100000:0.0:1787574684.124620:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1787574684.124631:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+17:15637:x1874407323734784:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574684.124657:0:19986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574684.124681:0:19986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb96d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb7c expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574684.124788:0:19986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787574684.124890:0:19986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb96d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb7c expref: 19 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.124905:0:19986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4be00) 00010000:00010000:0.0:1787574684.124909:0:19986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574684.124914:0:19986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb96d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb7c expref: 19 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.124932:0:19986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a9a00, rc 0) 00000100:00100000:0.0:1787574684.125013:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+18:15637:x1874407323734784:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 383us (669us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787574684.125020:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:2.0:1787574684.137368:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574684.137502:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323735040 00000100:00100000:1.0:1787574684.137513:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323735040 00000100:00100000:1.0:1787574684.137580:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1787574684.137591:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+18:15637:x1874407323735040:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1787574684.137858:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+19:15637:x1874407323735040:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 268us (501us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787574684.137885:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:2.0:1787574684.193378:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574684.193588:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323735296 00000100:00100000:1.0:1787574684.193604:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323735296 00000100:00100000:1.0:1787574684.193672:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:1.0:1787574684.193683:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+19:15640:x1874407323735296:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1787574684.193707:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574684.193728:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb96e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb83 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.193846:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb96eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.193860:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb96eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.193872:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb96eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574684.193884:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787574684.193989:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb96e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb83 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.194008:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb96eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb83 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.194017:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:1.0:1787574684.194020:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574684.194024:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74c00, rc 0) 00000100:00100000:1.0:1787574684.194108:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+21:15640:x1874407323735296:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 427us (739us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787574684.194115:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:2.0:1787574684.197367:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574684.197426:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574684.197563:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323735424 00000100:00100000:3.0:1787574684.197572:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323735424 00000100:00100000:3.0:1787574684.197629:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:3.0:1787574684.197639:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+21:15640:x1874407323735424:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1787574684.197706:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb96f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.197721:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb96f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.197732:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb96f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.197782:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb96f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.197790:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb96f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.197797:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb96f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.197803:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574684.197806:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb96f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.197814:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb96f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.197844:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:3.0:1787574684.197846:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787574684.197851:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb96f9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.197857:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb96f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574684.197933:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+21:15640:x1874407323735424:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 295us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574684.197941:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:1.0:1787574684.198372:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323735552 00000100:00100000:1.0:1787574684.198377:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323735552 00000100:00100000:1.0:1787574684.198431:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:1.0:1787574684.198439:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+21:2405:x1874407323735552:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574684.198449:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574684.198465:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74c00/0xd18a1efeeddb96eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb83 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.198476:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:1.0:1787574684.198480:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574684.198513:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+20:2405:x1874407323735552:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 75us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574684.198519:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1787574684.204461:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574684.204506:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323735808 00000100:00100000:1.0:1787574684.204518:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323735808 00000100:00100000:1.0:1787574684.204626:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:1.0:1787574684.204636:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+20:15640:x1874407323735808:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1787574684.204987:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+21:15640:x1874407323735808:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 350us (535us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787574684.204995:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000040:00080000:0.0:1787574684.274344:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574684.402209:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574684.402221:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346896000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574684.402230:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5349fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346895872:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787574684.402919:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574684.406406:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574684.408906:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346895872 00000100:00100000:0.0:1787574684.408927:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346895872 00000100:00100000:0.0:1787574684.409027:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787574684.409540:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346895872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574684.409584:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787574684.409682:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346895872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574684.409781:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5349fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346895872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574684.411095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574684.411511:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346896000 00000100:00100000:2.0:1787574684.411519:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346896000 00000100:00100000:0.0:1787574684.412261:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787574684.418325:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787574684.418479:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346896000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574684.418524:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787574684.418621:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346896000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 279us (7530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574684.418628:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787574684.418950:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346896000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574684.459560:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574684.459657:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323736064 00000100:00100000:0.0:1787574684.459670:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323736064 00000100:00100000:0.0:1787574684.459739:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:0.0:1787574684.459750:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+21:15671:x1874407323736064:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1787574684.459781:0:20285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574684.459808:0:20285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9700 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb8a expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.459926:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8c00/0xd18a1efeeddb9707 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.459940:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8c00/0xd18a1efeeddb9707 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.459954:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8c00/0xd18a1efeeddb9707 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574684.459978:0:20285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787574684.460296:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9700 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb8a expref: 24 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.460330:0:20285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8c00/0xd18a1efeeddb9707 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb8a expref: 23 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.460340:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:0.0:1787574684.460342:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574684.460347:0:20285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a8c00, rc 0) 00000100:00100000:0.0:1787574684.460422:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+23:15671:x1874407323736064:12345-192.168.202.40@tcp:101:cat.0 Request processed in 673us (871us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787574684.460429:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:2.0:1787574684.464931:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574684.465015:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323736192 00000100:00100000:3.0:1787574684.465027:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323736192 00000100:00100000:3.0:1787574684.465118:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:3.0:1787574684.465128:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+23:2404:x1874407323736192:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574684.465143:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574684.465169:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8c00/0xd18a1efeeddb9707 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb8a expref: 23 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.465186:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:3.0:1787574684.465191:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574684.465293:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+22:2404:x1874407323736192:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 166us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574684.465323:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:2.0:1787574684.467602:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574684.467713:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323736448 00000100:00100000:0.0:1787574684.467724:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323736448 00000100:00100000:0.0:1787574684.467770:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1787574684.467778:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+22:15671:x1874407323736448:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:0.0:1787574684.468475:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+23:15671:x1874407323736448:12345-192.168.202.40@tcp:35:cat.0 Request processed in 693us (879us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787574684.468484:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:2.0:1787574684.543722:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574684.543821:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323736704 00000100:00100000:3.0:1787574684.543833:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323736704 00000100:00100000:3.0:1787574684.543906:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:3.0:1787574684.543919:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+23:15677:x1874407323736704:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:3.0:1787574684.543950:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574684.543991:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb9715 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb91 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.544132:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.544148:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb96ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb6e expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.544156:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb75 expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.544164:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.544199:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb75 expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.544212:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb75 expref: 24 pid: 17142 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574684.544225:0:17144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346896128:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574684.544600:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb96ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb6e expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.544610:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb96ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb6e expref: 24 pid: 17145 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574684.544618:0:17144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403746680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346896256:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574684.544643:0:17144:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5035c8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574684.548045:0:17144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40429b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346896128:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574684.548063:0:17144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403746680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346896256:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574684.548095:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574684.548832:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574684.548883:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574684.548912:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323736832 00000100:00100000:1.0:1787574684.548921:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323736832 00000100:00100000:3.0:1787574684.548951:0:20172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323736960 00000100:00100000:3.0:1787574684.548955:0:20172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323736960 00010000:00010000:1.0:1787574684.548969:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb75 expref: 26 pid: 17142 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.548981:0:20172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb96ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb6e expref: 26 pid: 17145 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574684.549061:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1787574684.549072:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+26:2405:x1874407323736832:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574684.549087:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574684.549095:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb75 expref: 26 pid: 17142 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.549106:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb75 expref: 26 pid: 17142 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.549129:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53bd82200/0xd18a1efeeddb96cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb75 expref: 26 pid: 17142 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.549147:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:1.0:1787574684.549152:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.549161:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.549167:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574684.549219:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+25:2405:x1874407323736832:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 147us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574684.549226:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1787574684.549285:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1787574684.549300:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53c1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+24:2405:x1874407323736960:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574684.549308:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574684.549313:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb96ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb6e expref: 24 pid: 17145 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.549323:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb96ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb6e expref: 24 pid: 17145 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.549335:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb96ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb6e expref: 24 pid: 17145 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.549345:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:1.0:1787574684.549349:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.549356:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.549363:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.549382:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574684.549392:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.549412:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574684.549413:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53c1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+23:2405:x1874407323736960:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 115us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574684.549420:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000004:00200000:3.0:1787574684.549431:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787574684.549579:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb9715 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb91 expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.549609:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb91 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.549616:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:3.0:1787574684.549619:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574684.549621:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faa200, rc 0) 00000100:00100000:3.0:1787574684.549647:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+23:15677:x1874407323736704:12345-192.168.202.40@tcp:101:dd.0 Request processed in 5731us (5938us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787574684.549655:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:2.0:1787574684.551742:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574684.551792:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323737088 00000100:00100000:0.0:1787574684.551837:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323737088 00000100:00100000:0.0:1787574684.551910:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:0.0:1787574684.551918:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+23:15677:x1874407323737088:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:0.0:1787574684.551939:0:19986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574684.551966:0:19986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb972a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb98 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.551994:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8e00/0xd18a1efeeddb9731 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.552004:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8e00/0xd18a1efeeddb9731 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.552012:0:19986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8e00/0xd18a1efeeddb9731 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.552125:0:19986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb972a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb98 expref: 25 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.552142:0:19986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8e00/0xd18a1efeeddb9731 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb98 expref: 24 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.552148:0:19986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:0.0:1787574684.552150:0:19986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574684.552152:0:19986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a8e00, rc 0) 00000100:00100000:0.0:1787574684.552195:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+24:15677:x1874407323737088:12345-192.168.202.40@tcp:101:dd.0 Request processed in 277us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574684.552201:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:1.0:1787574684.560641:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574684.560694:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323737344 00000100:00100000:0.0:1787574684.560702:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323737344 00000100:00100000:0.0:1787574684.560743:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:0.0:1787574684.560750:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+24:15677:x1874407323737344:12345-192.168.202.40@tcp:36:dd.0 00010000:00010000:0.0:1787574684.560961:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.560993:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.561004:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574684.561051:0:20285:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787574684.561073:0:20285:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9ba6ac1 reply state 000000008331f554 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.561086:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.561093:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:0.0:1787574684.561096:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574684.561099:0:20285:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574684.561182:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+27:15677:x1874407323737344:12345-192.168.202.40@tcp:36:dd.0 Request processed in 432us (550us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787574684.561188:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000020:00080000:0.0:1787574684.561192:0:20285:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787574684.564956:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574684.565025:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323737472 00000100:00100000:1.0:1787574684.565033:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323737472 00000100:00100000:1.0:1787574684.565092:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:1.0:1787574684.565114:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+27:15677:x1874407323737472:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:1.0:1787574684.565134:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574684.565152:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb973f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bb9f expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.565201:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb973f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb9f expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.565210:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb973f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb9f expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574684.565224:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:1.0:1787574684.565226:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787574684.565229:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74800, rc 0) 00000100:00100000:1.0:1787574684.565293:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+28:15677:x1874407323737472:12345-192.168.202.40@tcp:101:dd.0 Request processed in 181us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574684.565298:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:1.0:1787574684.575879:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574684.575967:0:20172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323737728 00000100:00100000:3.0:1787574684.575975:0:20172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323737728 00000100:00100000:3.0:1787574684.576035:0:20172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1787574684.576044:0:20172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+28:15677:x1874407323737728:12345-192.168.202.40@tcp:103:dd.0 00010000:00010000:3.0:1787574684.576060:0:20172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574684.576085:0:20172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb973f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb9f expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.576107:0:20172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:3.0:1787574684.576112:0:20172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574684.576161:0:20172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+27:15677:x1874407323737728:12345-192.168.202.40@tcp:103:dd.0 Request processed in 119us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574684.576166:0:20172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:1.0:1787574684.579365:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574684.579490:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323737856 00000100:00100000:0.0:1787574684.579501:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323737856 00000100:00100000:0.0:1787574684.579558:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:0.0:1787574684.579568:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+27:15677:x1874407323737856:12345-192.168.202.40@tcp:58:dd.0 00010000:00010000:0.0:1787574684.579683:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.579701:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574684.579720:0:19986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574684.583122:0:19986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574684.583654:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787574684.583826:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787574684.583970:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+27:15677:x1874407323737856:12345-192.168.202.40@tcp:58:dd.0 Request processed in 4393us (4607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574684.583982:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:2.0:1787574684.592536:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574684.592627:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323737984 00000100:00100000:3.0:1787574684.592638:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323737984 00000100:00100000:3.0:1787574684.592707:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:3.0:1787574684.592718:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+27:15677:x1874407323737984:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:3.0:1787574684.592756:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574684.592778:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb974d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bba6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.592849:0:17142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.592860:0:17142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb974d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bba6 expref: 28 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.592878:0:17142:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.592891:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb974d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bba6 expref: 28 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.592905:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:3.0:1787574684.592909:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574684.592912:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb974d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bba6 expref: 28 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574684.592920:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca502faa800, rc 0) 00000100:00100000:3.0:1787574684.592990:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+28:15677:x1874407323737984:12345-192.168.202.40@tcp:101:dd.0 Request processed in 274us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574684.592997:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:3.0:1787574684.913646:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346896768:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.913719:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574684.913766:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346897280:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.913791:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574684.913808:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346897792:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.913832:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574684.913857:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787574684.913863:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346896384:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.913891:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574684.913918:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346896896:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.913940:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574684.913956:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346897408:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.913975:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574684.913989:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346897920:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914010:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574684.914041:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346896768 00000100:00100000:3.0:1787574684.914048:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346896768 00000100:00100000:3.0:1787574684.914099:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346897280 00000100:00100000:3.0:1787574684.914103:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346897280 00000100:00100000:3.0:1787574684.914125:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787574684.914134:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346896768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914184:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346896768:12345-0@lo:400:kworker.0 Request processed in 51us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574684.914192:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787574684.914208:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787574684.914214:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346897280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914268:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346897280:12345-0@lo:400:kworker.0 Request processed in 54us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574684.914283:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787574684.914307:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346896384 00000100:00100000:3.0:1787574684.914311:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346896384 00000100:00100000:3.0:1787574684.914336:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787574684.914344:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3636:x1874407346896384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914374:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3636:x1874407346896384:12345-0@lo:400:kworker.0 Request processed in 31us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574684.914380:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787574684.914451:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346896384:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914465:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346896768:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914473:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346897280:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914500:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346897792 00000100:00100000:3.0:1787574684.914503:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346897792 00000100:00100000:3.0:1787574684.914528:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346896896 00000100:00100000:3.0:1787574684.914530:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346896896 00000100:00100000:3.0:1787574684.914539:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346897408 00000100:00100000:3.0:1787574684.914541:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346897408 00000100:00100000:3.0:1787574684.914549:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346897920 00000100:00100000:3.0:1787574684.914551:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346897920 00000100:00100000:3.0:1787574684.914564:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787574684.914570:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346897792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914604:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346897792:12345-0@lo:400:kworker.0 Request processed in 34us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574684.914610:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787574684.914625:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574684.914631:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346896896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914664:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346896896:12345-0@lo:400:kworker.0 Request processed in 33us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574684.914670:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574684.914681:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574684.914686:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346897408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914709:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346897408:12345-0@lo:400:kworker.0 Request processed in 23us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574684.914713:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574684.914723:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787574684.914729:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40429b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346897920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914751:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40429b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346897920:12345-0@lo:400:kworker.0 Request processed in 23us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574684.914756:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787574684.914781:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346896896:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914790:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346897408:0@lo:400:kworker.0 00010000:00080000:3.0:1787574684.914799:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403746300 x1874407346897920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574684.914810:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346897920:0@lo:400:kworker.0 00000100:00100000:3.0:1787574684.914819:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346897792:0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.914931:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346896512:0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.914961:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574684.914990:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346897024:0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915008:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574684.915021:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346897536:0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574684.915053:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787574684.915059:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346896640:0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915076:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574684.915090:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346897152:0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915106:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574684.915118:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346897664:0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915133:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574684.915152:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346896640 00000100:00100000:2.0:1787574684.915156:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346896640 00000100:00100000:2.0:1787574684.915179:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346897152 00000100:00100000:2.0:1787574684.915181:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346897152 00000100:00100000:2.0:1787574684.915192:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787574684.915197:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346896640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915226:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346896640:12345-0@lo:400:kworker.0 Request processed in 29us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574684.915231:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787574684.915275:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787574684.915280:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346897152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915304:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346897152:12345-0@lo:400:kworker.0 Request processed in 25us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574684.915310:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787574684.915339:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346896640:0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915347:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346897152:0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915362:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346897536 00000100:00100000:2.0:1787574684.915364:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346897536 00000100:00100000:2.0:1787574684.915378:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346897664 00000100:00100000:2.0:1787574684.915380:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346897664 00000100:00100000:2.0:1787574684.915411:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787574684.915417:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346897536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915445:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346897536:12345-0@lo:400:kworker.0 Request processed in 29us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574684.915450:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787574684.915460:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787574684.915464:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346897664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915486:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346897664:12345-0@lo:400:kworker.0 Request processed in 22us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574684.915491:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1787574684.915509:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403745880 x1874407346897664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574684.915518:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346897664:0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.915526:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346897536:0@lo:400:kworker.0 00000100:00080000:0.0:1787574684.915773:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574684.915778:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574684.915780:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574684.915782:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574684.915788:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574684.915797:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346898048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574684.915829:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574684.915857:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346898048 00000100:00100000:0.0:1787574684.915861:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346898048 00000100:00100000:0.0:1787574684.915888:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574684.915894:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346898048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574684.915916:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787574684.915947:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346898048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574684.915954:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574684.915979:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346898048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574684.917335:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346896512 00000100:00100000:3.0:1787574684.917345:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346896512 00000100:00100000:0.0:1787574684.917595:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346898176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574684.917661:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574684.917716:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346898176 00000100:00100000:0.0:1787574684.917720:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346898176 00000100:00100000:0.0:1787574684.917749:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574684.917757:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346898176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574684.917786:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787574684.917841:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346898176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574684.917849:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574684.917888:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346898176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574684.918436:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346897024 00000100:00100000:3.0:1787574684.918442:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346897024 00000100:00100000:2.0:1787574684.923766:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787574684.923792:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50459aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346896512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.923911:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50459aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346896512:12345-0@lo:400:kworker.0 Request processed in 132us (8948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574684.923919:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787574684.923947:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787574684.923954:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca504599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346897024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574684.923986:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca504599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346897024:12345-0@lo:400:kworker.0 Request processed in 33us (8976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574684.923992:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787574684.924866:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346896512:0@lo:400:kworker.0 00000100:00100000:0.0:1787574684.924880:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346897024:0@lo:400:kworker.0 00010000:00010000:3.0:1787574685.042222:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574685.425457:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787574685.425468:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574685.425521:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787574685.425548:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787574685.425707:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e760000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17179:1874407346898304:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787574685.425813:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51e9a10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574685.435771:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574685.436020:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323738112 00000100:00100000:3.0:1787574685.436030:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323738112 00000100:00100000:3.0:1787574685.436088:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:3.0:1787574685.436098:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+29:15678:x1874407323738112:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787574685.436131:0:17142:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787574685.436283:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+29:15678:x1874407323738112:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 186us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574685.436291:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:0.0:1787574685.437004:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e760000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17179:1874407346898304:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787574685.453013:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574685.453125:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323738240 00000100:00100000:0.0:1787574685.453136:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323738240 00000100:00100000:0.0:1787574685.453200:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1787574685.453211:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+28:15678:x1874407323738240:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787574685.453341:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb9754 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453358:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb9754 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453382:0:19986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb9754 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453444:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9800/0xd18a1efeeddb975b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453452:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9800/0xd18a1efeeddb975b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453459:0:19986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9800/0xd18a1efeeddb975b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453483:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb9762 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453492:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb9762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453498:0:19986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb9762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574685.453550:0:19986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787574685.453556:0:19986:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574685.453570:0:19986:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb9762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453581:0:19986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb9754 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453587:0:19986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb9754 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453604:0:19986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb9754 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453610:0:19986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a9e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574685.453615:0:19986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb9754 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453623:0:19986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb9754 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453635:0:19986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca502b84b00) 00010000:00010000:0.0:1787574685.453639:0:19986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574685.453643:0:19986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb9754 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453650:0:19986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb9754 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453666:0:19986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9800/0xd18a1efeeddb975b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453672:0:19986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9800/0xd18a1efeeddb975b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453678:0:19986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9800/0xd18a1efeeddb975b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453683:0:19986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a9800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574685.453686:0:19986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9800/0xd18a1efeeddb975b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453702:0:19986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9800/0xd18a1efeeddb975b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453710:0:19986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ca534a4b000) 00010000:00010000:0.0:1787574685.453712:0:19986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574685.453715:0:19986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9800/0xd18a1efeeddb975b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453722:0:19986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9800/0xd18a1efeeddb975b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453735:0:19986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb9762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453742:0:19986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb9762 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453747:0:19986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb9762 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453752:0:19986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a8600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574685.453754:0:19986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb9762 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453760:0:19986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb9762 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453766:0:19986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:0.0:1787574685.453769:0:19986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574685.453772:0:19986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb9762 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.453786:0:19986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb9762 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574685.453854:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+28:15678:x1874407323738240:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 643us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574685.453862:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:1.0:1787574685.457802:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574685.458469:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323738496 00000100:00100000:0.0:1787574685.458482:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323738496 00000100:00100000:0.0:1787574685.458544:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:0.0:1787574685.458557:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+28:15678:x1874407323738496:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574685.458580:0:20285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574685.458601:0:20285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb9769 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bbad expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458710:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9770 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458726:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9770 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458737:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9770 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574685.458749:0:20285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787574685.458827:0:20285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9770 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458835:0:20285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9770 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458857:0:20285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9770 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458863:0:20285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a9400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574685.458867:0:20285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9770 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458874:0:20285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9770 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458886:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:0.0:1787574685.458889:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787574685.458893:0:20285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9770 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458899:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9770 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458946:0:20285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb9769 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbad expref: 30 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458956:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca502b84b00) 00010000:00010000:0.0:1787574685.458959:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574685.458980:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb9769 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbad expref: 30 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.458990:0:20285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a8400, rc 0) 00000100:00100000:0.0:1787574685.459048:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5349ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+29:15678:x1874407323738496:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 494us (1255us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1787574685.459065:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:2.0:1787574685.467791:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574685.467901:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323738624 00000100:00100000:0.0:1787574685.467912:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323738624 00000100:00100000:0.0:1787574685.467992:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:0.0:1787574685.468004:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+29:15678:x1874407323738624:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787574685.468050:0:17145:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787574685.468181:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+29:15678:x1874407323738624:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 178us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574685.468189:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:1.0:1787574685.472987:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574685.473818:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323738880 00000100:00100000:0.0:1787574685.473831:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323738880 00000100:00100000:0.0:1787574685.473900:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:0.0:1787574685.473911:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+29:15678:x1874407323738880:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574685.473931:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574685.473953:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb977e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bbb4 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787574685.474450:0:17144:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:0.0:1787574685.474458:0:17144:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1787574685.474477:0:17144:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1787574685.474625:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9785 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.474639:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9785 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.474651:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9785 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.474736:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb977e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbb4 expref: 32 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.474760:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9785 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbb4 expref: 31 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.474769:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b000) 00010000:00010000:0.0:1787574685.474772:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574685.474777:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a9400, rc 0) 00000100:00100000:0.0:1787574685.474868:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+31:15678:x1874407323738880:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 957us (1911us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787574685.474877:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:1.0:1787574685.479637:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574685.479729:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323739136 00000100:00100000:3.0:1787574685.479741:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323739136 00000100:00100000:3.0:1787574685.479796:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:3.0:1787574685.479807:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+31:15678:x1874407323739136:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787574685.479867:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574685.479894:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9400/0xd18a1efeeddb9785 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbb4 expref: 31 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.479918:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b000) 00010000:00010000:3.0:1787574685.479929:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574685.479953:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9793 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.479982:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9793 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.479993:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9793 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480063:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb979a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeaef548b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480084:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb979a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaef548b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480092:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb979a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaef548b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480141:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9793 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480150:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9793 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480157:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9793 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480165:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fabc00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574685.480170:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9793 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480180:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9793 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480188:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:3.0:1787574685.480192:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574685.480196:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9793 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480203:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb9793 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480217:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb979a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaef548b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480232:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb979a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaef548b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480280:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb979a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaef548b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480287:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574685.480290:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb979a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaef548b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480296:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb979a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaef548b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480305:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xeaef548b (ffff9ca502b84e00) 00010000:00010000:3.0:1787574685.480307:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574685.480310:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb979a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeaef548b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.480315:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb979a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeaef548b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574685.480404:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+30:15678:x1874407323739136:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 598us (779us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574685.480411:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:2.0:1787574685.493571:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574685.493673:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323739264 00000100:00100000:0.0:1787574685.493684:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323739264 00000100:00100000:0.0:1787574685.493749:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:0.0:1787574685.493760:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+30:15678:x1874407323739264:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574685.493780:0:19986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574685.493803:0:19986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97a1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bbbb expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.493838:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb97a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.493851:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb97a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.493863:0:19986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb97a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.493974:0:19986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbbb expref: 32 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.493993:0:19986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb97a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbbb expref: 31 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.494002:0:19986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:0.0:1787574685.494006:0:19986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574685.494009:0:19986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a8600, rc 0) 00000100:00100000:0.0:1787574685.494082:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+31:15678:x1874407323739264:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 323us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574685.494089:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:1.0:1787574685.500408:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574685.500520:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323739520 00000100:00100000:3.0:1787574685.500530:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323739520 00000100:00100000:3.0:1787574685.500595:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:3.0:1787574685.500607:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+31:15678:x1874407323739520:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787574685.500694:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.500723:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.500749:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574685.500923:0:20285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787574685.500933:0:20285:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624683691824ns, next at 625683689021ns, rc = 0 00000004:00010000:3.0:1787574685.500975:0:20285:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097979aa5 reply state 00000000e11c3e85 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.500988:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.500996:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:3.0:1787574685.500999:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787574685.501002:0:20285:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787574685.501104:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+33:15678:x1874407323739520:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 499us (704us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787574685.501111:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:2.0:1787574685.514439:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574685.514551:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323739648 00000100:00100000:0.0:1787574685.514562:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323739648 00000100:00100000:0.0:1787574685.514627:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:0.0:1787574685.514638:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+33:15678:x1874407323739648:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574685.514661:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574685.514684:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bbc2 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.514741:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc2 expref: 34 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.514756:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc2 expref: 34 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.514797:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:0.0:1787574685.514801:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574685.514805:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a8400, rc 0) 00000100:00100000:0.0:1787574685.514869:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+34:15678:x1874407323739648:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 233us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574685.514876:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:2.0:1787574685.522019:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574685.522121:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323739776 00000100:00100000:3.0:1787574685.522131:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323739776 00000100:00100000:3.0:1787574685.522277:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1787574685.522291:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323739776:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787574685.522375:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574685.522628:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:2403:x1874407323739776:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 338us (618us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787574685.522636:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:0.0:1787574685.527436:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574685.527632:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323740032 00000100:00100000:3.0:1787574685.527642:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323740032 00000100:00100000:3.0:1787574685.527701:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1787574685.527711:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+34:15678:x1874407323740032:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787574685.527948:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+35:15678:x1874407323740032:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 238us (523us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787574685.527956:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1787574685.538230:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574685.543938:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323740288 00000100:00100000:1.0:1787574685.543954:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323740288 00000100:00100000:1.0:1787574685.544033:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1787574685.544044:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+35:15678:x1874407323740288:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787574685.544167:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+35:15678:x1874407323740288:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 125us (5949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574685.544175:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:2.0:1787574685.549296:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574685.549585:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323740416 00000100:00100000:3.0:1787574685.549595:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323740416 00000100:00100000:3.0:1787574685.549659:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1787574685.549670:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+35:15678:x1874407323740416:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574685.549691:0:20285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574685.549710:0:20285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb97bd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bbc9 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.550006:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb97c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.550021:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb97c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.550031:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb97c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574685.550070:0:20285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574685.550087:0:20285:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb97c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.550113:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabc00/0xd18a1efeeddb97bd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc9 expref: 37 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.550131:0:20285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb97c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc9 expref: 36 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.550151:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:3.0:1787574685.550154:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787574685.550158:0:20285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19400, rc 0) 00000100:00100000:3.0:1787574685.550296:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+36:15678:x1874407323740416:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 627us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574685.550313:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:0.0:1787574685.562979:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574685.563134:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323740544 00000100:00100000:2.0:1787574685.563151:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323740544 00000100:00100000:2.0:1787574685.563214:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:2.0:1787574685.563225:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+6:2404:x1874407323740544:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574685.564452:0:18933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574685.564486:0:18933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb97cb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bbd0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574685.564520:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c399d, blocks: 0x0 00010000:00010000:2.0:1787574685.564543:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=624s v=(0 0) 00010000:00010000:2.0:1787574685.564564:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574685.564574:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb97cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd0 expref: 7 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.564595:0:18933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb97cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd0 expref: 7 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.564610:0:18933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82800, rc 0) 00000100:00100000:2.0:1787574685.564685:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:2404:x1874407323740544:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1460us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574685.564694:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:2.0:1787574685.572031:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574685.578976:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323740800 00000100:00100000:0.0:1787574685.578994:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323740800 00000100:00100000:0.0:1787574685.579120:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:0.0:1787574685.579132:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+36:15678:x1874407323740800:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787574685.579278:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+36:15678:x1874407323740800:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 149us (7257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574685.579287:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1787574685.582180:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574685.583519:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323740928 00000100:00100000:1.0:1787574685.583534:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323740928 00000100:00100000:2.0:1787574685.583627:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:2.0:1787574685.583639:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+36:15678:x1874407323740928:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787574685.587218:0:17123:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1787574685.587274:0:17123:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787574685.587639:0:17123:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1787574685.587677:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346898432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787574685.588121:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574685.588290:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.588458:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.588467:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.588472:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574685.588477:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.588497:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.588514:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:0.0:1787574685.588517:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787574685.588522:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.588528:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d000/0xd18a1efeeddb9658 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588649:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588657:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588663:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588668:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409ca00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574685.588671:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588677:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588691:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ca534a4b800) 00010000:00010000:2.0:1787574685.588694:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574685.588697:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588703:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddb9604 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588722:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588727:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588744:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588937:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574685.588941:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588947:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588956:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:2.0:1787574685.588958:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574685.588961:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588967:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d600/0xd18a1efeeddb960b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.588995:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589002:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589007:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589011:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574685.589014:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589020:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589027:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ca51874ab00) 00010000:00010000:2.0:1787574685.589029:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574685.589031:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589036:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75800/0xd18a1efeeddb96b3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589049:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589055:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589059:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589069:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a8a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574685.589073:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589078:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589086:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:2.0:1787574685.589088:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574685.589091:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589096:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8a00/0xd18a1efeeddb9738 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589106:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589112:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589116:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589120:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574685.589122:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589127:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589144:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:2.0:1787574685.589146:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787574685.589149:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.589154:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa400/0xd18a1efeeddb97af lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574685.589187:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346898432 00000100:00100000:2.0:1787574685.589196:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346898432 00000100:00100000:2.0:1787574685.589557:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787574685.589569:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346898432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787574685.589714:0:18650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787574685.589718:0:18650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787574685.589720:0:18650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787574685.589722:0:18650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787574685 -> 1787574685 00002000:00010000:2.0:1787574685.589725:0:18650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787574685.589902:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346898432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 334us (1782us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787574685.589911:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574685.590122:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+15:15678:x1874407323740928:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 6481us (7947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574685.590130:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000004:00080000:1.0:1787574685.590181:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca52e760700/2, rc 0, transno 8589934596 00000100:00100000:1.0:1787574685.590188:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346898432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787574685.596024:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574685.596203:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323741056 00000100:00100000:3.0:1787574685.596214:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323741056 00000100:00100000:3.0:1787574685.596297:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:3.0:1787574685.596423:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:2404:x1874407323741056:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787574685.596541:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:2404:x1874407323741056:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 233us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574685.596548:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:3.0:1787574685.608650:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574685.609007:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323741312 00000100:00100000:0.0:1787574685.609019:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323741312 00000100:00100000:0.0:1787574685.609096:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:0.0:1787574685.609106:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+15:15678:x1874407323741312:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574685.609160:0:20285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574685.609187:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19400/0xd18a1efeeddb97c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc9 expref: 15 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.609208:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:0.0:1787574685.609212:0:20285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574685.609289:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.609303:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.609313:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574685.609472:0:20285:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd35403c reply state 000000004d95b86c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.609485:0:20285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.609492:0:20285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:0.0:1787574685.609494:0:20285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574685.609498:0:20285:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574685.609607:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+16:15678:x1874407323741312:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 501us (967us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787574685.609614:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:2.0:1787574685.617317:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574685.617414:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323741440 00000100:00100000:0.0:1787574685.617425:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323741440 00000100:00100000:0.0:1787574685.617486:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1787574685.617498:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:15678:x1874407323741440:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574685.617516:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574685.617538:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bbd7 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.617573:0:18652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb97cb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd0 expref: 8 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.617582:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574685.617587:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574685.617593:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 8 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.617653:0:18652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb97cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd0 expref: 8 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.617668:0:18652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb97cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd0 expref: 8 pid: 18933 timeout: 724 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574685.617683:0:18652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18652:1874407346898560:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574685.617780:0:18652:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca505452e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574685.624540:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574685.624775:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323741568 00000100:00100000:1.0:1787574685.624786:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323741568 00010000:00010000:1.0:1787574685.624851:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb97cb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd0 expref: 9 pid: 18933 timeout: 724 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574685.624895:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1787574685.624906:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+9:2404:x1874407323741568:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574685.624920:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574685.624942:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb97cb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd0 expref: 9 pid: 18933 timeout: 724 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.624957:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb97cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd0 expref: 9 pid: 18933 timeout: 724 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.625007:0:17130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574685.625011:0:17130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574685.625018:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 9 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.625028:0:17130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 9 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.625064:0:17130:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 9 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574685.625078:0:17130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17130:1874407346898688:192.168.202.40@tcp:105: 00000100:00100000:1.0:1787574685.625161:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353d540 going to sleep for 11 seconds 00010000:00010000:0.0:1787574685.625505:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4e855ea/0xd18a1efeeddb97cb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd0 expref: 9 pid: 18933 timeout: 724 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574685.625522:0:18652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18652:1874407346898560:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574685.625548:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 8 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.625560:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a9000, rc 0) 00000100:00100000:0.0:1787574685.625592:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+8:15678:x1874407323741440:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 8096us (8288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574685.625600:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:3.0:1787574685.634076:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574685.634236:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323741696 00000100:00100000:2.0:1787574685.634283:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323741696 00000100:00100000:2.0:1787574685.634345:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:2.0:1787574685.634354:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+8:2405:x1874407323741696:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787574685.634513:0:18651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787574685.634530:0:18651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787574684 00002000:00010000:2.0:1787574685.634532:0:18651:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787574683 00002000:00010000:2.0:1787574685.634534:0:18651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787574685 -> 1787574684 00002000:00010000:2.0:1787574685.634537:0:18651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787574685.634591:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+9:2405:x1874407323741696:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 237us (522us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787574685.634599:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:1.0:1787574685.635214:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17130:1874407346898688:192.168.202.40@tcp:105: 00010000:00010000:1.0:1787574685.635269:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574685.635481:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+8:2404:x1874407323741568:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 10576us (10950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574685.635491:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1787574685.641209:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574685.641610:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323741824 00000100:00100000:2.0:1787574685.641621:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323741824 00000100:00100000:2.0:1787574685.641686:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:2.0:1787574685.641697:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+8:2403:x1874407323741824:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787574685.641812:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.641835:0:18650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 8 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.641843:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574685.641847:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574685.641852:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.641889:0:18650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 8 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.641903:0:18650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 8 pid: 18652 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574685.641938:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18650:1874407346898816:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574685.642689:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5317dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1787574685.646935:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18650:1874407346898816:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574685.646965:0:18650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574685.648167:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574685.648291:0:20172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323741952 00000100:00100000:2.0:1787574685.648301:0:20172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323741952 00010000:00010000:2.0:1787574685.648354:0:20172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 9 pid: 18652 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574685.648409:0:20172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:2.0:1787574685.648420:0:20172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+9:2404:x1874407323741952:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574685.648435:0:20172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574685.648457:0:20172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 9 pid: 18652 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.648471:0:20172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 9 pid: 18652 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.648494:0:20172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082883988/0xd18a1efeeddb97d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbd7 expref: 9 pid: 18652 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.648536:0:20172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574685.648541:0:20172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787574685.648547:0:20172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.648555:0:20172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.648590:0:20172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574685.648642:0:20172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+8:2404:x1874407323741952:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 223us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574685.648649:0:20172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00010000:00010000:3.0:1787574685.649165:0:18650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.649184:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.649206:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.649214:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.649222:0:18650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.649229:0:18650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574685.649233:0:18650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.649270:0:18650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.649283:0:18650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.649291:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f898ccb/0xd18a1efeeddb97e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574685.649374:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:2403:x1874407323741824:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 7678us (8174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574685.649382:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:2.0:1787574685.655026:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574685.655135:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323742208 00000100:00100000:0.0:1787574685.655146:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323742208 00000100:00100000:0.0:1787574685.655207:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:0.0:1787574685.655218:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+16:15678:x1874407323742208:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787574685.655359:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.655376:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8e00/0xd18a1efeeddb9731 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb98 expref: 16 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.655394:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.655428:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8e00/0xd18a1efeeddb9731 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb98 expref: 16 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.655441:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8e00/0xd18a1efeeddb9731 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb98 expref: 16 pid: 19986 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574685.655456:0:17144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346898944:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574685.655532:0:17144:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca505452e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574685.659199:0:17144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346898944:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574685.659229:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574685.663188:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574685.663528:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323742336 00000100:00100000:3.0:1787574685.663538:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323742336 00010000:00010000:3.0:1787574685.663588:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8e00/0xd18a1efeeddb9731 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb98 expref: 17 pid: 19986 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574685.663635:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1787574685.663645:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+17:2404:x1874407323742336:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574685.663660:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574685.663667:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8e00/0xd18a1efeeddb9731 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb98 expref: 17 pid: 19986 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.663680:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8e00/0xd18a1efeeddb9731 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb98 expref: 17 pid: 19986 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.663703:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8e00/0xd18a1efeeddb9731 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb98 expref: 17 pid: 19986 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.663718:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:3.0:1787574685.663723:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb974d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bba6 expref: 16 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.663732:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.663763:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.663770:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.663790:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574685.663860:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+16:2404:x1874407323742336:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 216us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574685.663869:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00010000:00010000:0.0:1787574685.664660:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.664671:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.664891:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.664911:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97b6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc2 expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.664919:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.664951:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc2 expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.664965:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc2 expref: 16 pid: 17145 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574685.664979:0:17144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346899072:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574685.665056:0:17144:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca505452d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574685.672521:0:17144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346899072:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574685.672552:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574685.676893:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574685.677279:0:20172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323742464 00000100:00100000:3.0:1787574685.677290:0:20172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323742464 00010000:00010000:3.0:1787574685.677362:0:20172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc2 expref: 17 pid: 17145 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574685.677412:0:20172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1787574685.677423:0:20172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+17:2404:x1874407323742464:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574685.677438:0:20172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574685.677445:0:20172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc2 expref: 17 pid: 17145 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.677459:0:20172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc2 expref: 17 pid: 17145 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.677481:0:20172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8400/0xd18a1efeeddb97b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbc2 expref: 17 pid: 17145 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.677516:0:20172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:3.0:1787574685.677521:0:20172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.677529:0:20172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.677535:0:20172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574685.677556:0:20172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574685.677611:0:20172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+16:2404:x1874407323742464:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 190us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574685.677619:0:20172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00010000:00010000:0.0:1787574685.679099:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.679115:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574685.679226:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787574685.679622:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787574685.679656:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787574685.680632:0:17144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17144:1874407346899200:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787574685.680709:0:17144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574685.680877:0:17144:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca505452480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574685.681506:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346899200 00000100:00100000:2.0:1787574685.681515:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346899200 00000100:00100000:2.0:1787574685.681564:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787574685.681573:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17144:x1874407346899200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787574685.681762:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17144:x1874407346899200:12345-0@lo:1000:mdt00_001.0 Request processed in 189us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574685.681769:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787574685.681938:0:17144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17144:1874407346899200:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787574685.682674:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787574685.682827:0:17144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17144:1874407346899328:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787574685.682880:0:17144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574685.682954:0:17144:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5054529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574685.682994:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346899328 00000100:00100000:3.0:1787574685.683001:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346899328 00000100:00100000:3.0:1787574685.683225:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787574685.683235:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17144:x1874407346899328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787574685.683453:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17144:x1874407346899328:12345-0@lo:1000:mdt00_001.0 Request processed in 219us (571us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787574685.683461:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787574685.683538:0:17144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17144:1874407346899328:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787574685.683579:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683604:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683612:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683617:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a9000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574685.683621:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683629:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683646:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:2.0:1787574685.683649:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574685.683653:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683658:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9000/0xd18a1efeeddb97ee lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683693:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683699:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683704:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683708:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a9a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574685.683718:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683723:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683731:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:2.0:1787574685.683733:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574685.683753:0:17144:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb974d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bba6 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683764:0:17144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb974d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bba6 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683771:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb974d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bba6 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574685.683820:0:17144:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb974d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bba6 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574685.683833:0:17144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346899456:192.168.202.40@tcp:105: 00000100:00100000:2.0:1787574685.683890:0:17144:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5317dd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574685.689126:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574685.689433:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323742592 00000100:00100000:3.0:1787574685.689443:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323742592 00000100:00100000:3.0:1787574685.689511:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1787574685.689522:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535e43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+20:15677:x1874407323742592:12345-192.168.202.40@tcp:49:dd.0 00000100:00100000:3.0:1787574685.689659:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535e43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+20:15677:x1874407323742592:12345-192.168.202.40@tcp:49:dd.0 Request processed in 138us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574685.689675:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:0.0:1787574685.691944:0:17144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1874407346899456:192.168.202.40@tcp:105: 00010000:00010000:0.0:1787574685.691974:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.691984:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9a00/0xd18a1efeeddb9746 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692026:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9600/0xd18a1efeeddb97f5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692049:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9600/0xd18a1efeeddb97f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692059:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9600/0xd18a1efeeddb97f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692068:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9600/0xd18a1efeeddb97f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692073:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9600/0xd18a1efeeddb97f5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692079:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9600/0xd18a1efeeddb97f5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692098:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a9600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574685.692102:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9600/0xd18a1efeeddb97f5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692108:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9600/0xd18a1efeeddb97f5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692121:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:0.0:1787574685.692124:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574685.692127:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9600/0xd18a1efeeddb97f5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692132:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9600/0xd18a1efeeddb97f5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692141:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692147:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692152:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692156:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a9c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574685.692158:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692163:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692178:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:0.0:1787574685.692181:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574685.692183:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.692188:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9c00/0xd18a1efeeddb97e7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574685.693611:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+19:15678:x1874407323742208:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 38384us (38585us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787574685.693623:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000020:00080000:0.0:1787574685.693629:0:17144:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787574685.695396:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574685.695557:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323742720 00000100:00100000:1.0:1787574685.695567:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323742720 00000100:00100000:1.0:1787574685.695627:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1787574685.695638:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+19:15677:x1874407323742720:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:1.0:1787574685.695658:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574685.695679:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb97fc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bbde expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.695724:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9803 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.695843:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9803 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.695856:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9803 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.695967:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb97fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbde expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.695986:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9803 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbde expref: 20 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.695994:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:1.0:1787574685.695997:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787574685.696000:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74800, rc 0) 00000100:00100000:1.0:1787574685.696133:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+20:15677:x1874407323742720:12345-192.168.202.40@tcp:101:dd.0 Request processed in 496us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574685.696140:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000040:00080000:2.0:1787574685.698539:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787574685.698549:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787574685.698570:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787574685.698575:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787574685.709979:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574685.710437:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323742976 00000100:00100000:1.0:1787574685.710450:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323742976 00000100:00100000:1.0:1787574685.710522:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:1.0:1787574685.710533:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+20:15678:x1874407323742976:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787574685.710901:0:17146:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787574685.710929:0:17146:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1787574685.710975:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb980a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.710992:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb980a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.711002:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb980a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.711009:0:17146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb980a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.711014:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb980a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.711019:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb980a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.711192:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787574685.711324:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+22:15678:x1874407323742976:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 792us (1356us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787574685.711333:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000020:00080000:1.0:1787574685.711338:0:17146:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787574685.719167:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574685.719182:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb980a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.719194:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574685.719198:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb980a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.719209:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb980a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.719227:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:0.0:1787574685.719230:0:17132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787574685.719235:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb980a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.719261:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75400/0xd18a1efeeddb980a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.719498:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574685.719501:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574685.719503:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574685.958552:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574685.959025:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323743104 00000100:00100000:0.0:1787574685.959050:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323743104 00000100:00100000:0.0:1787574685.959126:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1787574685.959137:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:2405:x1874407323743104:12345-192.168.202.40@tcp:4:dd.0 00002000:00010000:0.0:1787574685.959189:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a8c399c, atime: 0x6a8c399b, ctime: 0x6a8c399c, blocks: 0x0 00010000:00010000:0.0:1787574685.959198:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9811 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.959214:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=625s v=(0 0) 00010000:00010000:0.0:1787574685.959218:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574685.959224:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9811 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574685.959288:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9811 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574685.971414:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574685.971772:0:18657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787574685.971781:0:18657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787574685.972280:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323743232 00000100:00100000:3.0:1787574685.972290:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323743232 00000100:00100000:1.0:1787574685.979500:0:20287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1787574685.979524:0:20287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+8:2405:x1874407323743232:12345-192.168.202.40@tcp:4:dd.0 00010000:00010000:1.0:1787574685.979572:0:20287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8772e75/0xd18a1efeeddb9818 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.979596:0:20287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574685.979601:0:20287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574685.979608:0:20287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8772e75/0xd18a1efeeddb9818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574685.979621:0:20287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8772e75/0xd18a1efeeddb9818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.069414:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787574686.143722:0:19464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1787574686.143743:0:19464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1787574686.143957:0:18655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787574686.143975:0:18655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787574684 -> 1787574685 00002000:00010000:2.0:1787574686.143978:0:18655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787574684 -> 1787574685 00002000:00010000:2.0:1787574686.143980:0:18655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1787574686.143999:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9811 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.144013:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9811 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.144022:0:18655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9811 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.144028:0:18655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a9c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574686.144034:0:18655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9811 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.144050:0:18655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9811 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.144068:0:18655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9811 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.144076:0:18655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9811 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574686.144185:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+7:2405:x1874407323743104:12345-192.168.202.40@tcp:4:dd.0 Request processed in 185045us (185641us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787574686.144200:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000001:00080000:0.0:1787574686.181629:0:19464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1787574686.182338:0:20287:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1787574686.182345:0:20287:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1787574686.182363:0:20287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8772e75/0xd18a1efeeddb9818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.182376:0:20287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8772e75/0xd18a1efeeddb9818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.182396:0:20287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8772e75/0xd18a1efeeddb9818 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.182403:0:20287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574686.182408:0:20287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8772e75/0xd18a1efeeddb9818 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.182415:0:20287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8772e75/0xd18a1efeeddb9818 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.182434:0:20287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8772e75/0xd18a1efeeddb9818 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574686.182442:0:20287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8772e75/0xd18a1efeeddb9818 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574686.182557:0:20287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2405:x1874407323743232:12345-192.168.202.40@tcp:4:dd.0 Request processed in 203038us (211147us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787574686.182568:0:20287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00010000:00010000:1.0:1787574687.089577:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574687.475662:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346899584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574687.475739:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574687.475828:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346899584 00000100:00100000:1.0:1787574687.475836:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346899584 00000100:00100000:1.0:1787574687.475900:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574687.475910:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346899584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574687.475937:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787574687.475987:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346899584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574687.475995:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787574687.476064:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346899584:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787574687.477220:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1787574687.614891:0:20324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1787574688.009970:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574688.010016:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574688.010048:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574688.010076:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574688.010111:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574688.010132:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574688.010169:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574688.010202:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574688.010230:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574688.010292:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323743744 00000100:00100000:0.0:1787574688.010303:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323743744 00000100:00100000:0.0:1787574688.010356:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323744256 00000100:00100000:0.0:1787574688.010359:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323744256 00000100:00100000:0.0:1787574688.010404:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323743872 00000100:00100000:0.0:1787574688.010408:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323743872 00000100:00100000:0.0:1787574688.010421:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323744384 00000100:00100000:0.0:1787574688.010423:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323744384 00000100:00100000:0.0:1787574688.010441:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1787574688.010453:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323743744:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574688.010538:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323743744:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 85us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574688.010546:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1787574688.010564:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1787574688.010571:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323744256:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574688.010598:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323744256:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574688.010604:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1787574688.010615:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:0.0:1787574688.010621:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323743872:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574688.010645:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323743872:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574688.010652:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:0.0:1787574688.010672:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:0.0:1787574688.010678:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323744384:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574688.010704:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323744384:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574688.010710:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:0.0:1787574688.010731:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323743360 00000100:00100000:0.0:1787574688.010734:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323743360 00000100:00100000:0.0:1787574688.010756:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:0.0:1787574688.010762:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2403:x1874407323743360:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574688.010785:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2403:x1874407323743360:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574688.010792:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:0.0:1787574688.010823:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323743488 00000100:00100000:0.0:1787574688.010827:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323743488 00000100:00100000:0.0:1787574688.010852:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323744000 00000100:00100000:0.0:1787574688.010855:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323744000 00000100:00100000:0.0:1787574688.010865:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323743616 00000100:00100000:0.0:1787574688.010867:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323743616 00000100:00100000:0.0:1787574688.010879:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323744128 00000100:00100000:0.0:1787574688.010882:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323744128 00000100:00100000:0.0:1787574688.010895:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:0.0:1787574688.010901:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+22:2403:x1874407323743488:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574688.010934:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+22:2403:x1874407323743488:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 32us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574688.010942:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:0.0:1787574688.010954:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:0.0:1787574688.010960:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+6:2403:x1874407323744000:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574688.010994:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+6:2403:x1874407323744000:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574688.011000:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:0.0:1787574688.011010:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:0.0:1787574688.011016:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323743616:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574688.011037:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323743616:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574688.011043:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:0.0:1787574688.011055:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:0.0:1787574688.011061:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323744128:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574688.011082:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323744128:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574688.011088:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00080000:0.0:1787574688.011113:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574688.011117:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574688.011119:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574688.011121:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787574688.119124:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574688.500123:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574688.500147:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346899712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574688.500351:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574688.500424:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346899712 00000100:00100000:3.0:1787574688.500435:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346899712 00000100:00100000:3.0:1787574688.500522:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787574688.500534:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346899712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574688.500558:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574688.500640:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346899712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574688.500648:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787574688.500704:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346899712:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787574688.500786:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 44275 lines, 44275 kept, 0 dropped, 0 bad.